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(57) Atransmitting apparatusfor an interactive com- 
munication system using a broadcast wave, which in- 
cludes a first storage unit, a second storage unit, and a 
transmitting unit. The first storage unit stores a plurality 
of frames of image data. The second storage unit stores 
control information which shows links between said plu- 
rality of frames of image data stored in the first storage 
unit, and which indicates a combining of a supplemen- 
tary design with the image data. These supplementary 
designs are stored by a receiving apparatus and are 
combined with the image represented by the image da- 
ta. The transmitting unit repeatedly transmits a prede- 
termined number of frames of image data together with 
corresponding control information. 
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Description 

BACKGROUND OF THE INVENTION 

(1) Field of the Invention 

The present invention relates to a data communica- 
tion system, and to a data transmitting apparatus and 
data receiving apparatus, where simulated bidirectional 
communication processing is performed between a data 
transmitting apparatus and a data receiving apparatus 
using one-way communication, such as a television 
(TV) broadcast. 

(2) Description of the Prior Art 

It is now possible to connect personal computers in 
the home to networks using a standard telephone line 
and so receive a great variety of information provided 
by servers around the world. The most representative 
example of such a network is the World Wide Web 
(WWW) on the Internet. WWW servers transmit a com- 
bination of image information and control information, 
which has the image information displayed within text 
information, to personal computers as the data for dis- 
playing a one-page image on the personal computer's 
screen. When such pages are made up of text informa- 
tion alone, only control information for displaying this 
text information is transmitted. This control information 
is written using HTML (HyperText Markup Language), 
with browser software executed by the personal com- 
puter decoding and executing the HTML code to display 
each page on the WWW which is downloaded by the 
user. Here, information indicating a link to another page 
can be attached to character strings and images in a 
page, so that when the user makes a selection operation 
for such a character string or image using a mouse, for 
example, the browser will access the WWW server that 
provides the indicated page and will obtain the informa- 
tion for displaying this new page. On obtaining this in- 
formation, the browser will decode and execute its con- 
tent to display the new page. 

Japanese Laid-Open Patent Application 7-322226 
(1 995) discloses a method for multiplexing control infor- 
mation that can generate the kind of interactive display 
described above into a TV broadcast which is transmit- 
ted using a TV broadcast ground wave. In this method, 
the program transmitting apparatus multiplexes data, 
written in a language which resembles HTML for com- 
posing an interactive screen, into a program broadcast 
before transmitting. On receiving this broadcast, the 
program receiving apparatus interprets the composition 
of the interactive screen and combines basic display el- 
ements which have been stored inside its construction 
in accordance with the indicated composition to display 
the interactive screen. 

The above method has a major drawback in that the 
control information is written in a language for indicating 



a variety of control operations which are performed for 
display, so that the receiving apparatus needs to inter- 
pret and execute these control operations one by one 
to perform display. Additionally, most high resolution im- 
5 ages provided by WWW servers are compressed using 
complex techniques, so that when a receiving apparatus 
attempts to display such image information, it is usually 
necessary to perform decompression in addition to the 
processes for display in accordance with the control in- 
fo formation. Since such complex processing is required, 
the load of the receiving apparatus is considerable, 
which greatly increases the cost of the necessary hard- 
ware for the receiving apparatus. This problem makes 
this communication method unsuitable for a TV broad- 
15 cast communication system in which transmission is 
performed from a small number of transmitting appara- 
tuses to a large number of receiving apparatuses. 

SUMMARY OF THE INVENTION 

20 

In view of the above problems, it is a first object of 
the present invention to provide a transmitting appara- 
tus, a receiving apparatus, a reception method, a medi- 
um storing a reception program, and a communication 

25 system where interactivity is achieved by simulated bi- 
directional communication between a data transmitting 
apparatus and a data receiving apparatus in a one-way 
communication system such as a TV broadcast system, 
without increasing the load of the data receiving appa- 

30 ratus. 

A second object of the present invention is to have 
an image which emphasizes a specific part of the dis- 
play image displayed by the receiving apparatus in ad- 
dition to supplementary designs for a variety of buttons 

35 which make operations clearer and easierto understand 
for the user. Here, the user is able to customize these 
supplementary designs, the designs having a further 
benefit of reducing the amount of data transmitted to the 
receiving apparatus. 

40 These objects can be achieved by a transmitting ap- 
paratus for an interactive communication system using 
a broadcast wave, including: a first storage unit for stor- 
ing a plurality of frames of image data; a second storage 
unit for storing control information which shows links be- 

45 tween the plurality of frames of image data stored in the 
first storage unit, and which indicates a combining of a 
supplementary design with the image data stored in the 
first storage unit, the supplementary design being stored 
by a receiving apparatus and being combined with an 

50 image represented by the image data; and a transmit- 
ting unit for repeatedly transmitting a predetermined 
number of frames of image data together with corre- 
sponding control information. 

With the above construction, image data, control in- 

55 formation corresponding to the image data, and infor- 
mation indicating the combining of the image data with 
supplementary designs are repeatedly transmitted. The 
receiving apparatus will definitely receive the informa- 
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tion indicating the combining of supplementary designs 
and the linked image data indicated by the control infor- 
mation the next time such data is transmitted in the 
transmission cycle, so that interactive jumps to a user's 
desired image data can be performed one after the oth- 
er. As a result, broadcast signals which are limited to 
communication in one direction can be used to achieve 
an interactiveness which for the user will resemble bidi- 
rectional communication. Also, having the receiving ap- 
paratus combine supplementary designs with the image 
data makes the system very easy to operate. 

Here, the transmitting apparatus may include an ob- 
taining unit for obtaining pieces of page information rep- 
resenting a page containing characters and images, the 
page information including link information to showa link 
to another page, character information, and image in- 
formation; a first producing unit for producing one frame 
of image data containing characters and images in ac- 
cordance with the character information and image in- 
formation included in a piece of page information; and 
a second producing unit for interpreting the link informa- 
tion included in the obtained page information and pro- 
ducing, for each frame of image data, control informa- 
tion including image link information about a link to an- 
other frame of image data and supplementary design 
combining information indicating a combining of a sup- 
plementary design with the frame of image data gener- 
ated by the first producing unit, the supplementary de- 
sign being stored by a receiving apparatus and being 
combined with an image represented by the image data. 

With the above construction, page information re- 
ceived from an external source can be converted into 
image data, control information, and supplementary de- 
sign information which indicates a combining of supple- 
mentary designs for each set of image data, these sets 
of data being suited to broadcasting. 

Here, the obtaining unit may obtain the page infor- 
mation from the World Wide Web on the Internet. 

With the above construction, the transmitting appa- 
ratus can convert HTML documents on WWW servers 
on the Internet into image data, control information, and 
supplementary design information which it then broad- 
casts. As a result, the transmitting apparatus can pro- 
vide users with an interactive program which resembles 
"net surfing" on the Internet using only a TV broadcast 
wave. 

Here, the determining unit may determine a head- 
line as the specified image part, and the generating unit 
may generate supplementary design combining infor- 
mation which indicates a combining of the specific im- 
age part with a supplementary design for bold display. 

With the above construction, the transmitting appa- 
ratus can detect the headline written in an HTML docu- 
ment on a WWW server on the Internet and can gener- 
ate supplementary design combining information indi- 
cating a combining of the supplementary design at an 
image position of the headline. The receiving apparatus 
receives this supplementary design combining informa- 



tion and combines a supplementary design, which is 
made up of a frame which surrounds the title of the im- 
age data, with the image data to emphasize the title of 
the image data. 
s Here, the determining unit may determine one of a 
character and an image to which a link has been at- 
tached as the specific image part, and the generating 
unit may generate supplementary design combining in- 
formation indicating a combining of supplementary de- 
10 sign, which shows that a link to another frame of image 
data is attached, with the specified image part. 

With the above construction, the transmitting appa- 
ratus can determine the characters and images in a 
HTML page which have a link to another image attached 
is to them and can generate supplementary design com- 
bining information indicating a combining of these char- 
acters and images with a supplementary design. The 
receiving apparatus receives this supplementary design 
combining information and superimposes a supplemen- 
ts' tary design showing the attachment of a link to another 
image at a position in the image data of such linked char- 
acter or image to emphasize the characters and images 
to which links to other image data have been attached. 
Here, the second producing unit may include: a sup- 
25 plementary design storage unit for storing a supplemen- 
tary design beforehand; and a supplementary design 
adding unit for reading a supplementary design from the 
supplementary design storage unit and for adding the 
read supplementary design to the stored control infor- 
30 mation. 

With the above construction, the transmitting appa- 
ratus adds supplementary designs, which it already 
stores, to the control information, so that a receiving ap- 
paratus can receive this control information including 

35 supplementary designs from the transmitting apparatus, 
and can obtain the supplementary designs from the con- 
trol information which it then stores. The receiving ap- 
paratus can then combine these received supplemen- 
tary designs with image data, meaning that a variety of 

40 supplementary designs may be used by the receiving 
apparatus. 

The objects of the present invention can also be 
achieved by a receiving apparatus for an interactive 
communication system using a broadcast wave, where- 

45 in the broadcast wave is produced by multiplexing a plu- 
rality of frames of image data, and control information 
which includes image link information for each frame of 
image data showing links with other frames of image da- 
ta and supplementary design combining information in- 

50 dicating the combining of a supplementary design with 
the plurality of frames of image data, the broadcast wave 
being repeatedly transmitted, and the supplementary 
design being combined with an image of the image data, 
wherein the receiving apparatus includes: a separating 

55 unit for separating a frame of image data and corre- 
sponding control information from the broadcast wave; 
a supplementary design storage unit for storing at least 
one supplementary design; a supplementary design 
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reading unit for reading a supplementary design from 
the supplementary design storage unit, based on the 
separated control information; a combining unit for com- 
bining the read supplementary design with the separat- 
ed image data; a storage unit for storing the combined 
image data and separated control information; a repro- 
ducing unit for reproducing the stored image data to out- 
put an image signal; an operation unit for receiving an 
operation instruction from a user to switch image data; 
and a control unit for controlling the separating unit to 
separate another frame of image data designated by the 
control information stored in the storage unit according 
to the operation instruction. 

With the above construction, the receiving appara- 
tus receives the broadcast wave from the transmitting 
apparatus and separates one set of image data, repro- 
duces it and outputs it as an image signal in accordance 
with user operations to achieve a simulated interactive 
environment. The receiver apparatus will definitely re- 
ceive the image data indicated by control information 
and the control information for combining the image data 
with supplementary designs the next time this informa- 
tion is broadcast in the repeated transmission, so that 
the user can interactively select the linked image data 
which is to be displayed next. As a result, what appears 
to the user as interactive display using bidirectional 
communication can be achieved using a TV broadcast 
wave which only allows communication in one direction. 
Also, while servers in a bidirectional communication 
system have a load which changes depending on the 
number of requests from receiving apparatuses, mean- 
ing that the response time taken for the switching of the 
display image by a receiver apparatus can greatly vary, 
in the present invention the transmitting apparatus has 
no such changing load and so has a fixed cycle for re- 
peatedly broadcasting all of the image data. As a result, 
the receiving apparatus will always be able to switch the 
image data within a fixed response time, which at most 
will be the time taken by one transmission cycle. The 
control information received by the receiving apparatus 
includes information indicating a combining of a supple- 
mentary design with the image data, so that the supple- 
mentary design can be superimposed onto the image 
data to assist the user in making his/her operations. 

Here, the classification may indicate a headline as 
the specific image part and the supplementary design 
specifying unit may specify a supplementary design 
which emphasizes the specific image part. 

With the above construction, the receiving appara- 
tus receives the supplementary design combining infor- 
mation, and combines the supplementary design, which 
is a frame which surrounds the title of the display image, 
with the image data to emphasize the title. 

Here, the classification may indicate one of a char- 
acter and image to which a link has been attached as 
the specific image part and the supplementary design 
specifying unit may specify a supplementary design 
which shows that the specific image part has an at- 



tached link to other image data. 

With the above construction, the transmitting appa- 
ratus receives supplementary design combining infor- 
mation and combines the supplementary designs show- 
5 ing links to other image data at the positions of charac- 
ters or images which are linked to other sets of image 
data, so that the characters or images which are linked 
to other sets of image data are emphasized in the dis- 
play. 

Here, the supplementary designs stored in the sup- 
plementary design storage unit which are used for 
showing that a link to other image data is attached may 
be composed of two types which respectively corre- 
spond to a selection and a non-selection state, the op- 
eration unit may receive a selection operation from the 
user for one of a character and an image to which a link 
is attached, the receiving apparatus may include a state 
storage unit for storing a selection or non-selection state 
in accordance with an instruction from the operation 
unit, and the supplementary design reading unit may 
read a supplementary design corresponding to a state 
stored in the state storage unit from the supplementary 
design storage unit. 

With the above construction, the supplementary de- 
signs are of two types which respectively show a selec- 
tion and a non-selection state, so that the receiving ap- 
paratus can change the supplementary designs to be 
combined with the image data depending on whether 
the corresponding item is selected or not by the user. 
This clarification of the display assists the user in making 
his/her operations. 

Here, the control information received from a trans- 
mitting apparatus may further include a supplementary 
design, and the receiving apparatus may further com- 
prise a supplementary design recording unit for record- 
ing a supplementary design included in the separated 
control information in the supplementary design storage 
unit. 

With the above construction, the receiving appara- 
tus receives control information including supplementa- 
ry designs from the transmitting apparatus, obtains the 
supplementary designs from the control information, 
and stores them. The receiving apparatus then uses the 
stored supplementary designs when combining supple- 
mentary designs with the image data, so that a variety 
of supplementary designs can be used by the receiving 
apparatus. 

Here, the supplementary design storage unit may 
include a plurality of supplementary designs, the receiv- 
ing apparatus may further include a supplementary de- 
sign selecting unit for selecting one supplementary de- 
sign from the plurality of supplementary designs stored 
by the supplementary design storage unit, in accord- 
ance with a user operation, and the supplementary de- 
sign reading unit may read the selected supplementary 
design. 

With the above construction, the user can select his/ 
her desired supplementary designs. 
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The above objects can also be achieved by a re- 
ceiving method used in a receiving apparatus for an in- 
teractive communication system using a broadcast 
wave produced by multiplexing a plurality of frames of 
image data and control information including link infor- s 
mation showing a link to another of the plurality of 
frames of image data and supplementary design com- 
bining information for each frame of image data indicat- 
ing a combining of a supplementary design and the im- 
age data, the supplementary design being combined 10 
with an image represented by the image data, the re- 
ceiving method including: a separating step for separat- 
ing a frame of image data and corresponding control in- 
formation from the broadcast wave; a supplementary 
design reading step for reading a supplementary design 15 
stored in a memory; a combining step for combining the 
read supplementary design and the image data; a stor- 
age step for storing the combined image data and the 
separated control information in a memory; a reproduc- 
ing step for reproducing the image data stored in the 20 
memory to output an image signal; a operation step for 
receiving a user operation instruction to switch image 
data; a determining step for determining image data in- 
dicated by the control information stored in a memory 
according to the operation instruction; and a second 25 
separating step for separating the determined image da- 
ta and corresponding control information from the 
broadcast wave. 

The above object can also be achieved by a com- 
munication system which includes the transmitting ap- 30 
paratus and receiving apparatus described above. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects, advantages and features 35 
of the invention will become apparent from the following 
description thereof taken in conjunction with the accom- 
panying drawings which illustrate a specific embodi- 
ment of the invention. In the drawings: 

40 

Fig. 1 is a block diagram showing the structure of 
the data communication system 1 00 of the first em- 
bodiment of the present invention; 
Fig. 2 shows an example file list 200 stored in the 
file list storing unit 121; 45 
Fig. 3 shows the HTML document 301 "Report.html" 
which is the first page of a home page provided by 
a WWW server; 

Fig. 4 shows the image information 401 "Weather, 
gif" which is an image displayed on the first page of so 
the home page; 

Fig. 5 shows the HTML document 501 "Tokyo. html" 

which is the second page of the home page; 

Fig. 6 shows the HTML document 601 "Osaka.html" 

which is the third page of the home page; 55 

Fig. 7 shows an example of the link information table 

700 stored in the data conversion table storing unit 

122; 



Figs.8A to 8C show transmission data 800 for the 
first page of the WWW home page generated from 
the HTML document 301, audio information 
"Weather.au", and the image information 401; 
Figs.9A and 9B show transmission data 900 for the 
second page of the WWW home page generated 
from the HTML document 501 ; 
Figs. 1 0A and 1 0B show transmission data 1 000 for 
the third page of the WWW document qenerated 
from the HTML document 601 ; 
Fig. 1 1 A shows the transmission method for used by 
the transmitting unit 116 for transmitting the trans- 
mission data; 

Fig. 11 B shows a multiplexed stream transmitted in 
digital satellite broadcasting; 
Fig. 12 is a flowchart showing an overview of the 
procedure of the data transmitting apparatus 110; 
Fig. 13 is a flowchart showing an example informa- 
tion obtaining procedure of the information obtain- 
ing unit 111 ; 

Fig. 14 is a flowchart showing an example proce- 
dure for generating transmission data by the trans- 
mission data generating unit 112; 
Fig. 1 5 is a flowchart showing a detailed example of 
the processing in step S1312 of Fig. 14; 
Fig. 1 6 shows an example of the cursor design cor- 
respondence table which the control unit 155 gen- 
erates to control the display position of the cursor 
design; 

Fig. 17 shows an example of the design information 
stored by the control unit 155; 
Fig. 18 shows the display image 1800 which is the 
initial screen displayed by the display unit 154 
based on the transmission data 800 shown in Figs. 
8 A to 8C; 

Fig. 19 shows the display image 1900 which is the 
initial screen displayed by the display unit 155 
based on the transmission data 900 shown in Figs. 
9A and 9B; 

Fig. 20 shows the display image 2000 which is the 
initial screen displayed on the display unit 154 for 
the transmission data 1 000 shown in Figs. 1 0A and 
10B; 

Fig. 21 is a flowchart showing an example proce- 
dure for display control which is performed by the 
control unit 155; 

Fig. 22 is a block diagram showing the construction 
of the data communication system of the second 
embodiment of the present invention; 
Fig. 23 shows an example of the link information ta- 
ble which is the stored content of the data conver- 
sion table storing unit in the second embodiment; 
Figs.24A to 24C shows Lhe transmission data for 
the first page of a WWW home page which has been 
generated from a HTML document and the audio 
information "Weather.au" according to the second 
embodiment; 

Fig. 25 is a flowchart showing an example of the 



5 



9 



EP 0 810 790 A2 



10 



processing by the transmission data generating unit 
for an "<H1 >" tag in the second embodiment; 
Fig. 26 shows an example of the stored content of 
the design information storage unit in the second 
embodiment; 

Fig. 27 shows the display image for the first screen 
which is displayed in accordance with the transmis- 
sion data shown in Figs. 24A to 24C; 
Fig. 28 is a block diagram showing the construction 
of the data communication system of the third em- 
bodiment of the present invention; and 
Figs.29A to 29C shows the transmission data for 
the first page of a WWW home page which has been 
generated from a HTML document and the audio 
information "Weather.au" according to the third em- 
bodiment. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

First Embodiment 

Fig. 1 is a block diagram showing the construction 
of the data communication system 100 which is de- 
scribed in the present embodiment. This data commu- 
nication system 1 00 is composed of a data transmitting 
apparatus 110 and a plurality of data receiving appara- 
tuses 150. 

The data transmitting apparatus 1 1 0 includes an in- 
formation obtaining unit 111, a transmission data gen- 
erating unit 112, a transmission data holding unit 113, a 
transmission data reading unit 114, a multiplexing unit 
115, and a transmitting unit 116. 

Each data receiving apparatus 150 includes a sep- 
arating unit 1 51 , a received data holding unit 1 52, a re- 
producing unit 153, a display unit 154, a control unit 155, 
a signal receiving unit 1 56, and an audio output unit 1 57. 

Construction of the Information Obtaining Unit 111 

The information obtaining unit 111 includes a file list 
storing unit 1 21 and a buffer (not-illustrated) which holds 
information obtained from an external database, such 
as a WWW server. The file list storing unit 1 21 stores a 
file list 200 in which the file names of files that are to be 
obtained by the information obtaining unit 111 and the 
addresses of these files are stored corresponding to se- 
rial numbers which show the order in which the files are 
to be obtained. 

Fig. 2 shows an example of the file list 200 stored in 
the file list storing unit 121 . In the file names given in this 
list, the extension "html" indicates that a file is an HTML 
document, the extension "gif" indicates that a file is an 
image which has been compressed according to GIF 
(Graphics Interchange Format), and the extension "au" 
indicates that a file is audio information in AU format. 

This file list 200 shown in Fig. 2 shows the case 
when the information obtaining unit 111 is connected to 



the Internet and obtains information from WWW serv- 
ers. In this example ; the file list 200 is a table in which 
the URL (Uniform Resource Locator) of a directory on 
a WWW server is stored in the address column 202 cor- 

5 responding to each number in the serial number column 
201 . In the present example, each page in a home page 
provided by a WWW server can be composed of an 
HTML document and image files and audio files whose 
file names are indicated by the HTML document. As a 

10 result, the file name of the HTML document for each 
page is grouped together with the file names of the ac- 
companying image information files and audio files in 
the file name column 203 of the file list 200. 

It should be noted that there can be cases when the 

is address and file names stored in file list storing unit 121 
for each serial number in the file list do not need to be 
recorded separately, so that they may instead be repre- 
sented using a single URL. It is also possible for files to 
be obtained not from a WWW server, but from an exter- 

20 nal database. In this case, the address of the file is ex- 
pressed as the address of a device in the external da- 
tabase and the file is expressed by a file address in the 
database. 

The information obtaining unit 1 1 1 reads a URL and 
25 the file names which are to be obtained from the URL 
from the file list storing unit 121 in ascending order of 
the serial numbers in column 201 . It then accesses the 
WWW server indicated by the URL to obtain the indicat- 
ed files. The information obtaining unit 111 assigns file 
30 names to the obtained files and stores the files in the 
buffer, 

Examples of files 

35 The files obtained by the information obtaining unit 
111 are described below, with reference to Figs. 3, 4, 5, 
and 6. 

Fig. 3 shows the HTML document 301 "Report.html" 
which is the first page of a home page provided by a 

40 WWW server. The notation 'HTML document 301 "Re- 
port.html 1 " indicates the file of HTML document 301 
whose file name is "Report.html." 

In HTML documents, character strings written in- 
side "<>" brackets are called tags. These tags represent 

45 control codes and are used in pairs written as '^char- 
acter string>" and "</character string>". The control 
codes in tags indicate the execution of a corresponding 
control operation. 

Tags "<HTML> on line 311 and "</HTML>" on line 

50 323 in Fig. 3 indicate that the character strings between 
these tags form a single HTML document 301 . 

Tags "<H1>" and "</H1>" on line 312 indicate that 
the character string "WEATHER REPORT" between 
these tags is the headline of this document. 

55 Tags "<CENTER>" on line 313 and "</CENTER>" 
on line 315 indicate that the part of the document ex- 
pressed by the character strings between these tags 
should be centered. 
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'<IMG SRC="Weather.gif">' on line 314 indicates 
that the image information 401 "Weather.gif" shown in 
Fig. 4 is to be displayed in the document. Here, "SRC=" 
is an attribute of tag "<IMG>" and indicates an image 
information file. The attribute content of "SRC=" is 
"Weather.gif", indicating a file name. 

Fig. 4 shows the image information 401 "Weather, 
gif" which is an image displayed on the first page of the 
home page. 

As shown in Fig. 4, the image information 401 stored 
in image information file "Weather.gif" is a map of Japan 
which includes weather information. 

Tags "<P>" on line 316 and "</P>" on line 317 indi- 
cate that the character string "TOMORROW, THE 
WHOLE OF JAPAN WILL ENJOY SPRINGLIKE 
WEATHER" between these tags is a single paragraph. 

Tags "<UL>" on line 318 and "</UL>" on line 322 
indicate that the display items expressed by the charac- 
ter strings between these tags are displayed as an item- 
ized list without serial numbers. 

Each of the tags "<L1 >" on lines 31 9 and 320 indi- 
cates that the character string between this tag and the 
next "<L1 >" or "</UL>" forms an item in the itemized list. 

'<A HREF="Tokyo.html"> TOKYO </A>' on line 31 9 
of Fig. 3 indicates that the character string "TOKYO" is 
linked to the HTML document 501 "Tokyo. html" which is 
shown in Fig. 5. Here, character strings or images which 
are linked to other files, such as this character string 
"TOKYO", are called hot spots or anchor points. As one 
example, if a user uses the mouse to select the hot spot 
"TOKYO" which displayed on a computer monitor by a 
browser, the HTML document 501 "Tokyo. html" will be 
read by the browser and is displayed on the screen. 
Here, the attribute of tag "<A>", "HREF=", represents a 
link destination, and the attribute content of "HREF=", 
in this case "Tokyo.html", indicates a file name for the 
link destination file. 

'<A HREF="Osaka.html"> OSAKA </A>' on line 320 
of Fig. 3 indicates that the character string "OSAKA" is 
linked to the HTML document 601 "Osaka. html" which 
is shown in Fig. 6. Accordingly, this character string "OS- 
AKA" is also a hot spot. If hot spot "OSAKA" is selected, 
HTML document 601 "Osaka.html" will be displayed on 
the screen. 

'<A HREF="Weather.au"> AUDIO INFORMATION 
</A>' on line 321 of Fig.3 indicates that the character 
string "AUDIO INFORMATION" is linked to the audio file 
"Weather.au. ". making it another hot spot. If the hot spot 
"AUDIO INFORMATION" is selected, the audio file 
"Weather.au." will be reproduced. 

Fig. 5 shows the HTML document 501 "Tokyo.html" 
which is the second page of the home page. The tags 
included in the HTML document 501 have already been 
explained, so that the following explanation will only deal 
with the links to other pages. 

'<A HREF="Report.html"> RETURN </A>' on line 
511 of Fig. 5 indicates that the character string "RE- 
TURN" is linked to the HTML document 301 "Report. 



html" which is shown in Fig.3. 

Fig. 6 shows the HTML document 601 "Osaka.html" 
which is the third page of the home page. 

'<A HREF="Report.html"> RETURN </A>' on line 
s 611 of Fig. 6 indicates that the character string "RE- 
TURN" is linked to the HTML document 301 "Report, 
html" which is shown in Fig.3. 

The information obtaining unit 1 1 1 may obtain all the 
files listed in the file list 200 in order and store all of the 
10 obtained files in its buffer. Alternatively, the information 
obtaining unit 111 may obtain the listed files in units of 
one page and store the obtained files in the buffer. In 
this latter case, the files for a next page are only obtained 
after the processing of a current page has been com- 
15 pleted by the transmission data generating unit 112. 

Construction of Transmission Data Generating Unit 112 

The transmission data generating unit 112 includes 

20 a data conversion table storing unit 122 and a storage 
area (not shown in the drawings) which is used as the 
work area for generating transmission data. The data 
conversion table storing unit 122 includes a tag table, 
font files, and a link information table. The tag table is a 

25 list of control operations for every available HTML tag 
which each has its own flag. The font files each include 
character fonts for TV display which are classified for 
different purposes. The link information table is a table 
which expresses the link information for hot spots in a 

30 format recognized by the data communication system 
100. The work area is composed of a file storage area, 
a tag storage area, a character string storage area, and 
a flag storage area. The file storage area stores one 
HTML document file. The tag storage area stores the 

35 character strings which are written inside the "< >" 
brackets of each tag. The character string storage area 
stores character strings other than the ones between the 
"< >" brackets. The flag storage area is an area where 
flags which are usedfor controlling the generation of dis- 

40 play image information for one frame of image data are 
set. The character strings stored in the tag storage area 
and the character string storage area are deleted when 
the control operations corresponding to the taqs (flags) 
have been completed. If a plurality of flags are present 

45 in the flag storage area, the flags are set in ascending 
order and are reset in descending order. 

Fig. 7 shows an example of the link information table 
700 stored in the data conversion table storing unit 1 22, 
where the numbers, such as "9", are decimal values. 

50 As shown in Fig. 7, the link information stored in the 
link information table 700 is composed of index informa- 
tion 701 and hot spot information 702. 

Index information 701 is composed of an informa- 
tion identification part "INDEX=" for identifying the infor- 

55 mation as index information and a file identification 
number expressed as a four-figure decimal value. This 
file identification number is the identification number of 
a transmission data file which includes the current piece 
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of index information 701 . 

Hot spot information 702 is composed of an infor- 
mation identification part "HOTSPOT=" for identifying 
the information as hot spot information, X-Y coordinates 
"X=999,Y=999", for indicating a cursor position in the 
current display screen, an instruction "GO_TO_PAGE" 
which corresponds to the cursor position given by these 
coordinates; and a four-figure decimal variable showing 
the identification number of the transmission file linked 
to this cursor position. 

The transmission data generating unit 112 treats 
one set of the display image information to be generated 
along with the accompanying audio information and link 
information as a single transmission data file, based on 
one HTML document. Here, the transmission data gen- 
erating unit 112 esLablishes a storage area in each of 
the display image information storing unit 1 23, the audio 
information storing unit 124, and the link information 
storing unit 125 which are provided in the transmission 
data holding unit 1 1 3 (described later) so that the display 
image information, audio information, and link informa- 
tion to be included in one transmission data file are in- 
terrelatedly stored. Hereinafter the storage areas in the 
display image information storing unit 123, the audio in- 
formation storing unit 124, and the link information stor- 
ing unit 125 are respectively called the display image 
information storage area, the audio information storage 
area, and the link information storage area. 

The transmission data generating unit 112 assigns 
a same identification number to the display image infor- 
mation storage area, the audio information storage ar- 
ea, and the link information storage area used for storing 
the corresponding kinds of information in a same trans- 
mission data file. Here, the transmission data generat- 
ing unit 112 manages the audio information and link in- 
formation in a same transmission data file as separate 
files which are given the same identification number. 
This identification number may correspond to the serial 
number in column 201 of the file list, which in turn cor- 
responds to the file names of the present files which are 
given in column 203. 

The transmission data generating unit 112 fetches 
an unprocessed HTML document file which has been 
obtained by information obtaining unit 1 1 1 from the buff- 
er in the information obtaining unit 111 in accordance 
with the serial number 201 in the file list 200. The trans- 
mission data generating unit 112 then writes the file into 
the file storage area of the work area, in addition to gen- 
erating the index information in accordance with the for- 
mat of the index information 701 of the link information 
table 700. This generated index information is then 
stored at the front of the link information storage area in 
the transmission data holding unit 113. 

The transmission data generating unit 112 readsthe 
tags in order from the start of the HTML document and 
interprets the tags by looking each tag up in the tag table 
to find the corresponding control operations. This inter- 
pretation of control operation is performed by writing a 



character string detected after a tag start sign "<" one 
character at a time into the tag storage area provided in 
the work area until a tag end sign ">" is detected. The 
transmission data generating unit 112 then matches the 
s character string in the tag storage area with a tag written 
in the tag table. 

For tags which are not "<A>", "<IMG>", or '^char- 
acter string preceded by '/'>", the transmission data gen- 
erating unit 1 1 2 sets a flag showing the interpreted con- 
trol operation in the flag storage area provided in the 
work area and stores the character strings between the 
start tag "<>" and the corresponding end tag "</>" into 
the character string storage area in the work area so as 
to correspond to the set flag. The storage of character 
strings between a pair of corresponding tags is per- 
formed in the same way as the storage of the character 
strings included inside the tags themselves. The trans- 
mission data generating unit 1 1 2 converts the character 
strings in the character string storage area into text im- 
age using the fonts in one of the font files and arranges 
the text image in accordance with the control operation 
represented by the current flag to generate display im- 
age information. This generated display image informa- 
tion is then added to the display image information stor- 
age area provided in the transmission data holding unit 
113. Here, when a start tag "<character string>" is fol- 
lowed, not by a character string, but by another start tag 
"<another character string>", a flag is first set for the 
former tag in the flag storage area, before the process- 
ing is performed for the control operation indicated by 
the latter tag. 

If the read tag is "<IMG>", the transmission data 
generating unit 112 fetches the image information file 
with the file name specified by the attribute "SRC=" from 
the buffer of the information obtaining unit 111, and de- 
compresses the image information file under the format 
specified by the file name extension to convert the for- 
mat of the image into an appropriate image data format, 
such as bitmap data or graphics data. 

If, for example, the file name extension is ".gif", the 
transmission data generating unit 112 decompresses 
the image information file under GIF to convert the im- 
age information file into the appropriate format. If a pre- 
ceding flag is set for a control operation to be performed 
on the converted image, the converted imaqe is ar- 
ranged in accordance with this control operation to gen- 
erate display image information, otherwise the display 
image information is generated with the converted im- 
age being arranged in accordance with an initial setting. 
This generated display image information is then added 
to the display image information storage area. 

If the read tag is "<A>", the transmission data gen- 
erating unit 1 1 2 checks to see if the "link destination file" 
specified by attribute "HREF=" of "<A>" is an audio file 
which has a file name extension, such as "au", which 
indicates audio information. If the link destination file is 
an audio file, the transmission data generating unit 112 
fetches the audio file from the buffer of the information 



15 



20 



25 



30 



35 



40 



45 



50 



8 



15 



EP 0 810 790 A2 



16 



obtaining unit 111 and converts the audio information 
into audio data of a predetermined format, before storing 
it in the audio information storage area. 

If the link destination file is not an audio file, the 
transmission data generating unit 112 generates a text 
image for the character string between tags <A> and </ 
A>, and arranges the text image at a display position 
indicated by a preceding flag, or alternatively at a display 
position specified by an initial setting, with a space being 
reserved for displaying a cursor. By doing so, the trans- 
mission data generating unit 112 generates display im- 
age information which is then added to the display im- 
age information storage area provided in the transmis- 
sion data holding unit 113. The transmission data gen- 
erating unit 112 then calculates the X-Y coordinates for 
the space reserved for the cursor display position and 
refers to the hot spot information 702 in the link informa- 
tion table 700 to generate hot spot information from the 
calculated X-Y coordinates and the "link destination file 
name" specified by the attribute "HREF=" of tag "<A>". 
In doing so, the transmission data generating unit 112 
refers to the file list 200 and finds the serial number 201 
corresponding to the file name in column 203 which in 
turn corresponds to the link destination file name of tag 
"<A>", before writing this serial number 201 into the hot 
spot information as the file identification number. If the 
link destination file name is not present in the file list 
200, the transmission data generating unit 112 writes 
the file name of the current file into the hot spot informa- 
tion. After doing so, the transmission data generating 
unit 112 adds the generated hot spot information to the 
link information storage area provided in the transmis- 
sion data holding unit 113. 

After completing all the above processes for an 
HTML document, the transmission data generating unit 
112 writes a graphic representation of the identification 
number of the display image information area at a pre- 
determined position in the non-displayed area of the dis- 
play image information stored in the display image in- 
formation area. In the present embodiment; the identifi- 
cation number has been described as being a four-fig- 
ure decimal value, although the number of decimal digits 
is not limited to four. The identification number may al- 
ternatively be represented in binary notation, as a com- 
bination of numerals, characters and symbols, as a 
graphical figure, as a bar code, or even as a file name. 
Here, the audio information stored in the audio informa- 
tion storage area and the link information stored in the 
link information storage area are also appended with the 
identification numbers of the corresponding storage ar- 
eas, in the same way as with standard digital data files. 

Through the processes described above, the trans- 
mission data generating unit 112 generates a first, sec- 
ond, and third page of transmission data 800, 900, and 
1 000, which are respectively the first, second, and third 
pages of the home page provided by the WWW server, 
from the HTML document 301 , the audio information not 
shown in the drawings, the image information 401 , the 



HTML document 501 , and the HTML document 601 . 

Transmission Data Generated by The Transmission 
Data Generating Unit 112 

5 

Figs.8A to 8C show the transmission data 800 that 
is the first page of the home page provided by the WWW 
server. This first page of transmission data 800 has been 
generated from the HTML document 301 , the audio in- 
fo formation "Weather.au, " and the image information 401 . 
Figs.9A and 9B show the transmission data 900 that is 
the second page of the home page provided by the 
WWW server which has been generated from the HTML 
document 501. Figs. 1 0A and 10B show the third page 
15 of transmission data 1000 that is the third page of the 
home page which has been generated from the HTML 
document 601. As shown in Figs.8A to 8C, the trans- 
mission data 800 includes the display image information 

801 , the audio information 802, and the link information 
20 803 which is related to display image information 801. 

Here, Fig.8A shows the display image which is the con- 
tent of the display image information 801 , Fig.8B shows 
a representation of the content of the audio information 

802, and Fig.8C shows the content of the link informa- 
25 tion 803. 

In Fig.8A, the area surrounded by the dotted line 
above the display image information 801 is a non-dis- 
played area which is provided in each set of display im- 
age information. As its name suggests, this non-dis- 

30 played area is not displayed on the screen of the display 
unit 154. An image of an identification number, such as 
"0001 " shown in the drawing ; is written into the top-right 
corner of the non-displayed area by the transmission da- 
ta generating unit 1 1 2. The displayed area of display im- 

35 age information 801 is one display image which is com- 
posed of an image which was originally expressed as 
image information and character strings which have 
been converted from the original character code files in- 
to images. 

40 The audio information 802 is linked to the character 
string "AUDIO INFORMATION" which is a hot spot in 
the HTML document 301. Here, the file which includes 
the audio information 802 is also given the identification 
number "0001", as shown in Fig.8B. 

45 The file storing the link information 803 is also given 
the identification number "0001", as shown in Fig.8C. 
This link information 803 is used for control purposes, 
and is not displayed. "<INDEX=0001 >" on line 811 of 
the link information 803 is the index information which 

50 indicates that the file identification number of the trans- 
mission data 800 is "0001 V 

The character string on line 812 indicates that in- 
struction "GO_TO_PAGE(0002) M is related to a position 
in display image information 801 which is specified by 

55 the coordinates (1 00,600) and that a cursor image held 
by the data receiving apparatus 1 50 should be displayed 
at this position. Instruction "GO_TO_PAGE(0002)" indi- 
cates that a page having identification number "0002", 
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which in this case corresponds to the transmission data 
900, should be displayed. 

The character string on line 813 indicates that the 
instruction M GO_TO_PAGE(0003)" is related to a posi- 
tion in the display image information 801 specified by 
the coordinates (1 00,700) and that a cursor image held 
by the data receiving apparatus 1 50 should be displayed 
at this position. This instruction M GO_TO_PAGE(0003)" 
indicates that a page having identification number 
"0003", which in this case corresponds to the transmis- 
sion data 1000, should be displayed. 

Figs.9A and 9B show the transmission data 900 
which is the second page of the home page provided by 
the WWW server. This transmission data 900 includes 
the display image information 901 and the link informa- 
tion 902, which is related to the display image informa- 
tion 901. Here, Fig.9A shows the display image which 
is the content of the display image information 901 and 
Fig.9B shows the content of the link information 902. 

As shown in Fig.9A, an image of the identification 
number "0002" is written in the top-right corner of the 
non-displayed area of the display image information 901 
which is shown by the dotted line, in the same way as 
with the display image information 801 . 

As shown in Fig.9B, the file storing link information 
902 is given the identification number "0002". 

In Fig.9B, <INDEX=0002> on line 911 is the index 
information, indicating that the file identification number 
for transmission data 900 is "0002". 

The character string on line 912 indicates that the 
instruction "GO_TO_PAGE(0001) M is related to a posi- 
tion in the display image information 901 specified by 
coordinates (050,400) and that a cursor image held by 
the data receiving apparatus 150 should be displayed 
at this position. This instruction "GO_TO_PAGE(0001)" 
indicates that a page having identification number 
"0001 ," which in this case corresponds to the transmis- 
sion data 800, should be displayed. 

Fig. 1 0A and 1 0B show the transmission data 1 000 
which is the third page of the home page provided by 
the WWW server. Transmission data 1 000 includes dis- 
play image information 1001 and link information 1002, 
which is related to display image information 1001. 
Here, Fig. 10Ashows the display image which is the con- 
tent of the display image information 1001 and Fig. 1 0B 
shows the content of the link information 1002. 

As before, an image of the identification number 
"0003" is written into the top-right corner of the non-dis- 
played area of display image information 1001 . 

As shown in Fig. 1 0B, the file storing link information 
1002 is given the identification number "0003". 

"<INDEX=0003>" on line 1011 of the link informa- 
tion 1002 is the index information, indicating that the 
identification number of the files of the transmission data 
1000 is "0003". 

The character string on line 1 012 indicates that the 
instruction "GO_TO_PAGE(0001) M is related to a posi- 
tion in the display image information 901 specified by 



the coordinates (050,400) and that a cursor image 
should be displayed at this position. This instruction 
"GO_TO PAGE(0001)" indicates that a page having 
identification number "0001", which in this case corre- 
s sponds to transmission data 800, should be displayed. 

Illustrative Example of the Processing by the 
Information Obtaining Unit 111 and the Transmission 
Data Generating Unit 112 

10 

The following is a specific example of the process- 
ing performed by the information obtaining unit 111 and 
the transmission data genera tiny unit 112 in which the 
files shown in Figs. 3, 4, 5, and 6 are obtained and are 
is used to generate the transmission data shown in Figs. 
8, 9, and 10. 

Processing by the Information Obtaining Unit 111 

20 The information obtaining unit 111 first refers to the 
file list storing unit 121 and issues a connection request 
to the indicated WWW server on the Internet. The infor- 
mation obtaining unit 111 then obtains the HTML docu- 
ment 301 "Report. html" from this WWW server, assigns 
25 it the file name "Report. html", and stores the file in the 
buffer. The information obtaining unit 111 also obtains 
the compressed image information 401 , the HTML doc- 
ument 501 , and the HTML document 601 in the same 
way from the WWW server. 

30 

Processing by the Transmission Data Generating Unit 
112 

The transmission data generating unit 112 allocates 

35 storage areas in the transmission data holding unit 113 
for respectively storing the display image information 
801 , the audio information 802, and the link information 
803 which compose the transmission data 800. In doing 
so, the transmission data generating unit 112 assigns 

40 the identification number "0001 " for retrieving transmis- 
sion data 800 to these storage areas. The transmission 
data generating unit 112 then fetches the (yet-unproc- 
essed) HTML document 301 from the buffer of the infor- 
mation obtaining unit 111 and writes this document into 

45 the file storage area in the work area. 

The transmission data generating unit 112 then 
generates the index information "<INDEX=0001 >" 
shown in line 811 of the transmission data 800 for the 
first page of the WWW home page from the file name 

50 "Report. html" of HTML document 301, before storing 
the generated index information at the start of the link 
information storage area for link information 803 which 
is provided in the transmission data holding unit 113. 
The transmission data generating unit 112 then 

55 reads the tag "<HTML>" from line 311 in the HTML doc- 
ument 301 and stores the character string "HTML" in the 
"<HTML>" tag in the tag storage area of the work area. 
It then refers to the tag table stored in the data conver- 
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sion table storing unit 122 to interpret the tag, and by 
doing so recognizes that line 311 is the first line of the 
HTML document 301 . After doing so, it deletes the char- 
acter string "HTML" from the tag storage area. 

Next, the transmission data generating unit 112 
reads the tag "<H1>" on line 312 and refers to the tag 
table to interpret its content. On doing so, it sets the 
headline flag in the flag storage area in the work area. 
Here, the headline flag shows that the character string 
following the "<H1>" tag is a headline and so should be 
displayed using a headline font. The characters in the 
character string after the "<H 1 >" tag are then written one 
character at a time into the character string storage area 
until the "</H 1 >" tag appears, which in the present case 
results in the character string "WEATHER REPORT" be- 
ing written into the character string storage area and be- 
ing converted into display image information using the 
headline font. This generated display image information 
is then added to the display image information storage 
area set in the transmission data holding unit 113. After 
this, the headline flag in the work area is reset, the char- 
acter string "WEATHER REPORT" is deleted from the 
character string storage area, and the character string 
"H1 " is deleted from the tag storage area. 

Next, the transmission data generating unit 112 
reads the tag "<CENTER>" on line 313 and sets the 
centering flag in the workarea. The centering flag shows 
that the character string which follows the correspond- 
ing tag is to be centered on the display. Here, there is 
no character string following the "<CENTER>" tag which 
can be centered, so that the transmission data generat- 
ing unit 112 continues by reading line 314. 

The transmission data generating unit 112 readsthe 
tag '<IMG SRC="Weather.gif">' on line 314 and refers 
to the tag table to interpret the content of the tag. The 
transmission data generating unit 11 2 then investigates 
whether the file for the image information 401 , which is 
expressed by the file name "Weather.gif", is present in 
the buffer of the information obtaining unit 111, and, 
since this is the case, reads the file. The transmission 
data generating unit 112 then converts the image infor- 
mation 401 which is stored and compressed in the read 
file into a bitmap image or other such format, in accord- 
ance with a GIF decompression method. 

The transmission data generating unit 112 then 
reads the tag "</CENTER>" on line 315 and arranges 
the bitmap image converted from image information 401 
in accordance with the centering flag set in the work ar- 
ea. The display image information thus generated is 
then added to the display image information storage ar- 
ea in the transmission data holding unit 113, before the 
centering flag in the work area is reset. 

The transmission data generating unit 112 then 
reads the "<P>" tag on line 316 and sets the paragraph 
flag. The paragraph flag shows that the character strings 
displayed between this start tag and the "</P" end tag 
should be displayed as a single paragraph which is to 
be inserted into the following blank line. As with 



"WEATHER REPORT" on line 31 2, the character string 
"TOMORROW, THE WHOLE OF JAPAN WILL ENJOY 
SPRINGLIKE WEATHER" between these tags is read 
and is stored in the character string storage area in the 

5 work area. Next after reading the "</P>" tag, the trans- 
mission data generating unit 1 1 2 converts the character 
string "TOMORROW, THE WHOLE OF JAPAN WILL 
ENJOY SPRINGLIKE WEATHER" into an image using 
the font for paragraph display which is stored as one of 

10 the font files and adds the generated display image in- 
formation to the storage area in the transmission data 
holding unit 113 for display image information storage 
area 801. After this, the content of the work area is 
cleared as before. 

is The transmission data generating unit 112 next 
reads the tag "<UL>" on line 318, interprets it, and sets 
the itemized list flag in the work area. The itemized list 
flag shows that each character string which follows the 
tag and is interpreted as one item should be displayed 

20 as a non-numbered item in a list. 

The transmission data generating unit 112 next 
reads the tag "<L1 >" on line 31 9, refers to the tag table, 
interprets the tag as indicating the start of one item in a 
list, and sets the item flag in the flag storage area. The 

25 item flag shows that the display position on the display 
screen should be shifted to the next line every time an 
"<L1>" or "</L1>" tag is read. 

The transmission data generating unit 1 1 2 reads the 
tag "<A HREF="Tokyo.html>" following the tag "<L1>" 

30 and writes it into the tag storage area. The transmission 
data generating unit 112 then interprets this tag "<A 
HREF="Tokyo.html>" and sets the link flag in the flag 
storage area. 

When the extension of the file name given as the 

35 attribute of the "<A>" tag indicates audio information, the 
linkflag shows that processing for the audio information 
is to be performed so that the audio information is con- 
verted into a predetermined format and stored in the au- 
dio information storage area. When the extension of the 

40 file name given as the attribute of the "<A>" tag does 
not indicate audio information, the linkflag shows that 
the character string between the "<A>" and "</A>" tags 
which is appended with the link by the "<A>" tags is to 
be converted into an image with a two-character space 

45 provided before it as a cursor display area. The linkflag 
also shows that display image information is to be gen- 
erated for this character string in addition to hot spot in- 
formation which is generated in accordance with the for- 
mat of the hot spot information 702. 

50 The transmission data generating unit 1 1 2 reads the 
character string "TOKYO" between the "<A HREF= "To- 
kyo. html>" and "</A>" tags and writes it into the char- 
acter string storage area. After reading the "</A>" tag, 
the transmission data generating unit 112 converts the 

55 character string "TOKYO" into an image with a two-char- 
acter space provided before it as a cursor display area 
and arranges the character string in accordance with the 
itemized list flag to generate display image information 
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which it adds to the display image information storage 
area provided in the transmission data holding unit 113. 
The transmission data generating unit 112 then calcu- 
lates the coordinates of the cursor di. splay position as 
(100,600), and uses these coordinates and the attribute 
"Tokyo. html" stored in the tag storage area of the work 
area to generate the hot spot information shown on line 
812 of Fig.8. After doing so, the transmission data gen- 
erating unit 1 1 2 adds the generated hot spot information 
to the link information storage area provided in the trans- 
mission data holding unit 113. Having done so, the 
transmission data generating unit 1 1 2 deletes the char- 
act e r st ri n g " A H R E F= " To ky o. h t m I " i n t h e tag sto rag e a r- 
ea of the work area and the character string "TOKYO" 
in the character string storage area, in addition to reset- 
ting the linkflag. 

Next, on reading the "<L1>" tag on line 320, the 
transmission data generating unit 112 shifts the display 
position for the next display image to the following line 
in accordance with the item flag, and, in the same way 
as with line 319, generates display image information 
for the character string "OSAKA", in addition to gener- 
ating the hot spot information shown on line 81 3 of Fig. 
8C. The generated display image information is then 
added to the display image information storage area 
provided in the transmission data holding unit 113 and 
the generated hot spot information is added to the link 
information storage area. After this, the transmission da- 
ta generating unit 112 deletes the character string "A 
HREF="Osaka.html" and the character string "OSAKA", 
and resets the linkflag. 

Next, on reading the "<L1>" tag on line 321, the 
transmission data generating unit 112 shifts the display 
position for the next display image to the following line 
in accordance with the item flag, and sets the link flag 
in accordance with the tag "A H RE F="Weath er.au". On 
investigating the file name extension of the attribute in 
accordance with the link flag, the transmission data gen- 
erating unit 1 1 2 finds that the link destination file is audio 
information in AU format, so that it converts the AU for- 
mat audio information into audio information of a prede- 
termined format, before storing the converted audio in- 
formation in the audio information storage area provided 
in the transmission data holding unit 113. 

Next, on reading the "</L1>" tag on line 322, the 
transmission data generating unit 112 interprets that the 
itemized list is complete, and resets the itemized list flag 
and the item flag. 

Finally, on reading the "</HTML>" tag on line 323, 
the transmission data generating unit 1 1 2 interprets that 
the HTML document 301 has ended, and so terminates 
the generation process for transmission data 800. 

Following this, the transmission data generating 
unit 112 finds that there is an unprocessed HTML doc- 
ument 501 and so sets a display image information stor- 
age area for display image information 901 and a link 
information storage area for link information 902 in the 
transmission data holding unit 11 3 for storing the com- 



posite parts of the transmission data 900, in doing so 
giving both storage areas the identification number 
"0002" for the retrieval of the transmission data 900. It 
then reads the unprocessed HTML document 501 from 

s the buffer of the information obtaining unit 11 1 and writes 
it into the work area. 

The transmission data generating unit 112 then 
generates the index information "<INDEX=0002>" 
shown in line 911 of the transmission data 900 which 

10 displays the second page of the WWW home page from 
the file name "Tokyo. html" of the HTML document 501 , 
before storing the generated index information at the 
start of the link information storage area for the link in- 
formation 902 which is provided in the transmission data 

is holding unit 1 1 3. In the same way as with the generation 
of the transmission data 800 from the HTML document 
301 andthe image information 401 , the transmission da- 
ta generating unit 112 then generates the transmission 
data 900 from the HTML document 501 and the trans- 

20 mission data 1 000 from the HTML document 601 , with 
no further explanation of this process being given. 

Construction of the Transmission Data Holding Unit 113, 
the Transmission Data Reading Unit 114, the 
25 Multiplexing Unit 115, and the Transmitting Unit 116 

The transmission data holding unit 113 includes a 
display image information storing unit 123, an audio in- 
formation storing unit 124, and a link information storing 
30 unit 1 25, with simultaneous retrieval from these units be- 
ing possible. 

The display image information storing unit 123 can 
be realized by RAM (Random Access Memory) or a hard 
disk device, and is provided with a plurality of display 

35 image information storage areas which are set by the 
transmission data generating unit 112. Each of these 
display image information storage areas stores one file 
of display image information which is generated by the 
transmission data generating unit 112. 

40 The audio information storing unit 124 can also be 
realized by RAM (Random Access Memory) or a hard 
disk device, and is provided with a plurality of audio in- 
formation storage areas which are set by the transmis- 
sion data generating unit 112. Each of these audio in- 

45 formation storage areas stores one file of audio infor- 
mation which is generated by the transmission data gen- 
erating unit 112. 

The link information storing unit 125 can also be re- 
alized by RAM (Random Access Memory) or a hard disk 

50 device, and is provided with a plurality of link information 
storage areas which are set by the transmission data 
generating unit 112. Each of these link information stor- 
age areas stores one file of link information which is gen- 
erated by the transmission data generating unit 112. 

55 The transmission data reading unit 114 simultane- 
ously reads the display image information, the audio in- 
formation, and the link information in a same transmis- 
sion data file from the storage areas provided in the 
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transmission data holding unit 11 3 in the order of the file 
identification numbers for the transmission data, and 
outputs the read information to the multiplexing unit 115. 
After reading the files for the transmission data which 
has the final identification number, the transmission data s 
reading unit 114 returns to the transmission data with 
the identification number "0001" and once again reads 
the transmission data in the order of the identification 
numbers. This is to say, the transmission data reading 
unit 1 1 4 cyclically reads the transmission data from the 10 
transmission data holding unit 1 1 3 in order of identifica- 
tion numbers and outputs the transmission data to the 
multiplexing unit 115. In doing so, there is the following 
difference in the reading method when audio informa- 
tion is or is not present. When no audio information is is 
present, the transmission data reading unit 114 advanc- 
es to the reading of a set of transmission data with the 
next identification number after reading a first set of 
transmission data once. When audio information is 
present the transmission data reading unit 114 reads 20 
the audio information and advances to the reading of a 
set of transmission data with the next identification 
number only after reading the display image information 
and the link information a plurality of times for the period 
which is required by the reproduction of the audio infor- 25 
mation. As one example, if the audio information has a 
reproduction period of two seconds, the transmission 
data reading unit 114 will read the audio information 
once, and will read the display image information and 
link information 60 times (30 frames per second * 2 sec- 30 
onds), before advancing to the reading of a set trans- 
mission data with the next identification number. In this 
way, the transmission time for audio information can be 
maintained. 

The multiplexing unit 1 1 5 multiplexes the display im- 35 
age information (including the audio information) and 
the link information read by the transmission data read- 
ing unit 114, and outputs multiplexed data to the trans- 
mitting unit 116. Here, this multiplexing can be per- 
formed using the same method as conventional teletext 40 
broadcasting. In such a case, display image information 
and audio information are multiplexed in the same way 
as the images and audio included in conventional TV 
broadcasts, while link information is multiplexed in the 
same way as the text information multiplexed with tele- 45 
text broadcasts. This is to say, when no audio informa- 
tion is present, the display image information is trans- 
mitted in the image section of one frame of the television 
image signal, while the link information is transmitted in 
the retrace section of the same one frame of the televi- so 
sion image signal. When audio information is present, 
the audio information is transmitted as the television au- 
dio signal, while the corresponding display image infor- 
mation and link information are transmitted in the image 
area and retrace area, respectively of the television im- 55 
age signal for the number of frames required by the re- 
production of the audio information. 

The transmitting unit 1 1 6 successively transmits the 



transmission data which has been multiplexed by the 
multiplexing unit 115 on a TV broadcast ground wave. 

Transmission Method for the Transmission Data 

Fig. 1 1 A gives a graphic representation of the trans- 
mission method used by the transmitting unit 116. Fig. 
11 A shows the case when n pages (n being a positive 
integer) of transmission data are generated by the trans- 
mission data generating unit 112. In Fig.11A ; a pairing 
of audio information and display image information with 
a same identification number is expressed as one trans- 
mission unit corresponding to a normal TV broadcast, 
and the link information for the same identification 
number is expressed as one transmission unit corre- 
spondingtothetext information which is multiplexed into 
a standard teletext broadcast. 

As shown in Fig. 11 A, in addition to being identified 
by the same identification number, the display image in- 
formation, audio information, and link information stored 
in one transmission data file are transmitted at a corre- 
sponding time. Also, the transmission data from the first 
to the n th page in the transmission data holding unit 113 
are cyclically transmitted in the order of identification 
numbers. 

It should be noted here that while the transmission 
data reading unit 114 has been described as reading the 
display image information, the audio information, and 
the link information stored in the same transmission data 
file simultaneously from the display image information 
storing unit 123, the audio information storing unit 124, 
and the link information storing unit 125 and as having 
the read display image information, audio information, 
and link information transmitted with related identifica- 
tion numbers and transmission timing, the display image 
information and the link information do not need to be 
transmitted with a related timing. As one example, the 
transmission data reading unit 1 1 4 may instead be com- 
posed of a first reading unit and a second reading unit. 
Here, the first reading unit is constructed to continuously 
read pairs of display image information from the display 
image information storing unit 123 and audio informa- 
tion from the audio information storing unit 124 which it 
then outputs to the multiplexing unit 115. The second 
reading unit is constructed to continuously read only the 
link information from the link information storing unit 1 25 
which it then outputs to the multiplexing unit 1 1 5. By do- 
ing so, the display image information and link informa- 
tion belonging to a same transmission data file do not 
need to be transmitted by the transmitting unit 1 1 6 at the 
same time, since the data receiving apparatus 150 can 
use the identification number commonly given to the dis- 
play image information and the link information to re- 
combine pairs of the display image information and the 
link information. 

The multiplexing unit 115 has also been described 
as multiplexing the display image information (including 
the audio information) and the link information which are 
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generated by the transmission data generating unit 1 1 2, 
with the transmitting unit 1 1 6 transmitting the transmis- 
sion data which has been multiplexed by the multiplex- 
ing unit 115 on a TV broadcast ground wave, although 
the display image information and link information do not 
need to be multiplexedtogether for transmission. As one 
example, the display image information and the audio 
information may be transmitted on a TV broadcast 
ground wave or as a digital satellite broadcast, while the 
link information may be transmitted using a telephone 
link and modem, or the like. Transmission here may al- 
ternatively be performed using multiple channels. 

When digital satellite broadcasting is used as the 
data transmission method, compression/encryption and 
multiplexing may be performed according to MPEG2 
(Moving Pictures Experts Group) video standard and 
system standard, so that display image information may 
be set as I pictures, with the audio information and link 
information being set as private information. Here, when 
it is possible for the display image information, audio in- 
formation, and link information to be transmitted as dig- 
ital data, it is no longer necessary to write a graphic rep- 
resentation of the identification number into the non-dis- 
played area of the display image information, so that the 
identification numbercan be simply appended to the dis- 
play image information and audio information, in the 
same way as with the link information. Incidentally, a de- 
tailed description of MPEG2 standard is given in "Sa- 
ishin MPEG Kyoukasho [Latest MPEG Reader]" pub- 
lished by ASCII Publishing, Inc. 

Fig. 11 B shows the multiplexed stream which is 
transmitted when digital satellite broadcasting is used. 
The upper part of this drawing shows a transport stream 
under MPEG2 standard which has been generated by 
the multiplexing unit 115. 

The symbols "V1 , A1 , L1 " in the transport stream 
represent the display image information, audio informa- 
tion, and link information which have the identification 
number "0001" and which are read from the transmis- 
sion data file and multiplexed together. This is also the 
case for "V2, A2, L2 ... "Vn, An, Ln". 

"V1 " is a video elementary stream which shows the 
display image information which has been converted in- 
to I (Intra) pictures under MPEG2 standard, with the PID 
(Packet IDentifier) "0x0100" having been attached to 
identifythe stream. This isalsothecasefor "V2" ... "Vn". 

"A1" is an audio elementary stream which shows 
the audio information which has been converted under 
MPEG2 standard, with the PID "0x0101" having been 
attached to identify the stream. This is also the case for 
"A2" ... "An". 

"L1 - Ln" are private sections according to MPEG2 
standard for attaching each set of link information, with 
the PID "0xB0" having been attached to identify these 
as private sections. Here, identification numbers are al- 
so set in the table I D extensions to identify separate sets 
of link information. Each of these sets of link information 
is set at least one pairing of one part of the image area 



of the corresponding display image and information 
showing a link to another display image. As one exam- 
ple, in "L1 ", the display area centered on the coordinates 
(X,Y)=(1 00,600) is set the link "GOTO_PAGE(0002)" 

5 representing a link to the display image with the identi- 
fication number "0002", while the display area centered 
on the coordinates (X,Y)=(1 00,700) is set the link 
"GOTO_PAGE(0003) M representing a link to the display 
image with the identification number "0003". 

10 The correspondence between the PIDs described 
above and the identification numbers is set according to 
the PMT (Program Map Table) under MPEG2 standard. 
Here, the correspondence between the PIDs and the 
identification numbers can be written in the descriptors 

is of the private sections, such as by setting the identifica- 
tion numbers as the component tags in the PMT as 
shown in Fig. 1 1 B. 

In the above case, the video elementary stream, au- 
dio elementary stream, and private sections are gener- 
ic ated by the transmission data generating unit 112 and 
are stored in the transmission data holding unit 113. 
Here, a set of one video elementary stream, one audio 
elementary stream, and one private section stored in the 
transmission data holding unit 113 corresponds to one 

25 transmission data file. Here, the video elementary 
stream, audio elementary stream, and private section 
stored as one set in the transmission data holding unit 
113 are each read once, with the transmission data 
reading unit 1 1 4 cyclically reading all of the transmission 

30 data files. Using this data, transport streams are gener- 
ated by the multiplexing unit 1 1 5. 

As described above, by multiplexing n sets of dis- 
play image information, audio information, and link in- 
formation with a PMT in the transport stream, transmis- 

35 sion data can be easily transmitted using digital satellite 
broadcasting. 

Overview of the Procedure of the Data Transmitting 
Apparatus 110 

40 

The following is a detailed explanation of the pro- 
cedure of the data transmitting apparatus 110, with ref- 
erence to Figs. 12 to 14. 

Fig. 12 is a flowchart showing an overview of the 
45 procedure of the data transmitting apparatus 1 1 0. 

The information obtaining unit 1 1 1 obtains a desired 
set of information from an external database and stores 
it in its internal buffer (step S1 101). 

The transmission data generating unit 112 inter- 
so prets the information obtained by the information obtain- 
ing unit 111 and generates display image information, 
audio information, and link information, which it stores 
in the transmission data holding unit 1 1 3 (step S1 1 02). 

The transmission data reading unit 1 1 4 successive- 
55 |y reads the transmission data from the transmission da- 
ta holding unit 113 in order of identification numbers 
(step S1103). 

The multiplexing unit 1 1 5 multiplexes the display im- 
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age information (including the audio information) with 
the link information, and the transmitting unit 116 trans- 
mits the multiplexed transmission data using a television 
broadcast ground wave. 

Procedure of the Information Obtaining Unit 111 

Fig. 13 is a flowchart showing an example informa- 
tion obtaining procedure of the information obtaining 
unit 111. 

The information obtaining unit 111 first refers to the 
file list in the file list storing unit 1 21 and checks whether 
there is any as-yet-unobtained information (step 
S1201). If there is not, the information obtaining proce- 
dure is terminated. If there is, the file addresses (or 
URLs) of the as-yet-unobtained sets of information are 
fetched one at a time (step S1 202). 

The information obtaining unit 111 then requests a 
connection with an external database, based on the 
fetched address (step S1203), and checks whether the 
connection has been successively established (step 
S1204). If the connection is unsuccessful, the process- 
ing returns to step S1203 (step S1204). 

If the connection has been successful, the informa- 
tion obtaining unit 111 reads the file names of the as- 
yet-unobtained information from the file list, obtains the 
corresponding files from the external database, and 
stores them in the internal buffer (step S1205). The 
processing then returns to step S1 201 . 

Procedure of the Transmission Data Generating Unit 
112 

Fig. 14 is a flowchart showing an example proce- 
dure for generating transmission data by the transmis- 
sion data generating unit 112. 

The transmission data generating unit 112 first re- 
fers to the buffer in the information obtaining unit 111 
and checks whether any unprocessed HTML docu- 
ments exist (step S1301). If no such documents exist, 
the display image generating procedure is terminated. 
If there is such a document, the transmission data gen- 
erating unit 112 establishes the transmission data stor- 
age areas in the transmission data holding unit 1 1 3, as- 
signs an identification number to each transmission data 
storage area, and then fetches an unprocessed HTML 
document from the buffer (step S1302). 

The transmission data generating unit 112 creates 
index information indicative of the file name of the trans- 
mission data from the file name of the fetched HTML 
document, and adds the index information to the link in- 
formation storage area established in the transmission 
data holding unit 113 (step 51303). 

One character is read from the fetched HTML doc- 
ument and is written into the character string storage 
area (step S1304). 

The transmission data generating unit 112 then 
checks whether the read character is a tag start sign "<" 



(step S1305). If so, the processing advances to step 
S1 307, or if not, the character is added to the character 
string storage area in the work area, and the processing 
returns to step S1 304 (step S1306). 

s The next character is read (step S1307), and the 
transmission data generating unit 112 judges whether 
the read character is a tag end sign ">" (step S1 308). If 
so, the processing advances to step S1 310, or if not, the 
read character is added to the tag storage area in the 

10 working area, before the processing returns to step 
S1307 (step S1309). 

The character string in the tag storage area is com- 
pared with the tag table, and a check is performed to 
see whether it starts with a "/" sign (step S1310). If it 

15 does, the transmission data generating unit 112 judges 
whether the read tag is a "</HTML>" tag (step S1311). 
If so, the transmission data generating unit 112 resets 
the work area, and the processing returns to step 
S1310. If the read tag is not "</HTML>", the transmis- 

20 sion data generating unit 112 operates in accordance 
with the least significant of the flags set in the flag stor- 
age area corresponding to this read tag, and resets the 
corresponding storage area in the work area (step 
S1 31 2), before the processing returns to step S1 304. 

25 in step S1310, when the character string does not 
start with 7", a check is performed to see whether the 
read tag is "<IMG>" (step S1 31 3). If so, the transmission 
data generating unit 112 fetches the image information 
file specified by the attribute of the "<IMG>" tag from the 

30 buffer in the information obtaining unit 111 (step S1 31 4). 
The fetched image information is converted in accord- 
ance with a GTF decompression method into image in- 
formation expressed as bitmap data (step S1315), and 
the processing returns to step S1304. 

35 |f the read tag is not "<IMG>", the character string 
in the tag storage area is compared with the content of 
the tag table and a flag corresponding to the tag is set 
in the flag storage area. The transmission data gener- 
ating unit 112 then operates in accordance with this tag 

40 (step S1316), before the processing returns to step 
S1304. 

A variety of tags can be employed in the HTML doc- 
uments, and the processes represented by these tags 
can be performed in the same way as a conventional 

45 browser. Accordingly, the following explanation focuses 
on an example of the processing in step S1312 for the 
tag "</A>" which relates to the link information which 
generated in a special format for this data communica- 
tion system 100. 

50 Fig. 1 5 is a flowchart showing a detailed example of 
the processing in step S1312 of Fig. 14. 

The transmission data generating unit 112 first 
checks whether the read tag is "<A>" (step SI 401 ), and 
if not, the processing advances to step S1408. 

55 |f the read tag is "<A>", the transmission data gen- 
erating unit 112 judges whether the link destination file 
specified by the attribute is an audio information file 
(step S1402). If it is, the processing advances to step 
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51407, or if not, the transmission data generating unit 
1 1 2 generates display image information for the charac- 
ter string established in the character string storage ar- 
ea, in doing so leaving a display area for displaying a 
cursor design, before adding the generated display im- 
age information to the display image information storage 
area provided in the transmission data holding unit 1 1 3 
(step S1403). 

The transmission data generating unit 11 2 then cal- 
culates the X-Y coordinates which express the display 
position of the cursor design (step S1404). 

The transmission data generating unit 112 then 
generates hot spot information based on the calculated 
X-Y coordinates and the attribute established in the tag 
storage area, and adds it to the link information storage 
area provided in the transmission data holding unit 1 1 3 
(step S1405). 

The transmission data generating unit 112 then re- 
sets the link flag in the work area, and deletes the char- 
acter string in the tag storage area and the character- 
sequence storage area (step S1406). 

The transmission data generating unit 112 fetches 
an audio information file and converts the audio infor- 
mation contained in the file into information of a prede- 
termined format which it stores in the audio information 
storage area (step S1407). 

The transmission data generating unit 1 1 2 operates 
in accordance with the read tag (step S1408). 

Structure of the Data Receiving Apparatus 150 

The following is an explanation of the components 
of the data receiving apparatus 150, with reference to 
Figs. 16 to 20. 

Structure of the Separating Unit 151 

The separating unit 151 includes a read buffer 161 
for reading the identification number allotted to trans- 
mission data. The read buffer 161 has storage areas for 
temporarily holding the display image information (in- 
cluding audio information) included in one transmission 
file and the link information included in one transmission 
file. 

The separating unit 151 separates display image in- 
formation (including audio information) and link informa- 
tion from the received transmission data, and stores the 
separated display image information and link informa- 
tion in the corresponding storage areas of the read buff- 
er 161. The identification number assigned to the dis- 
play image information stored in the storage area is read 
by recognizing the image written in the predetermined 
part of the non-displayed area of the display image in- 
formation. The identification number assigned to the link 
information is read in the same manner as when reading 
an identification number assigned to a conventional dig- 
ital data file. If the read identification number is the iden- 
tification number designated by the control unit 1 55, the 



display image information (including audio information) 
or the link information held by the read buffer 161 is 
stored in the corresponding storage area in the received 
data holding unit 152. At this point, any audio informa- 

5 tion which is present is stored by the separating unit 151 
in a corresponding storage area provided in the received 
data holding unit 152 at the same time as the display 
image information is stored, so that the audio informa- 
tion is gradually accumulated while the display image 

10 information with the identification number designated by 
the control unit 155 is repetitively transmitted. By doing 
so, audio information which is transmitted across a plu- 
rality of frames can be separated from the transmission 
data. 

is If the read identification number is not the identifi- 
cation number designated by the control unit 155, the 
display image information (including audio information) 
or its link information held by the read buffer 161 is dis- 
carded. The reading of new display image information 
20 (including audio information) and link information is con- 
tinued, and the above procedure is repeated until the 
identification number designated by the control unit 1 55 
is detected. 

25 Structures of the Received Data Holding Unit 152, the 
Reproducing Unit 153, and the Display Unit 154 

The received data holding unit 152 stores display 
image information (including audio information) and link 

30 information separated by the separating unit 1 51 linked 
with their assigned identification number. The storage 
area for storing the display image information can be 
achieved by RAM or a hard disk device capable of stor- 
ing one static image which is the size of the display 

35 screen. 

The reproducing unit 153 reproduces the display 
image information stored in the received image holding 
unit 152 along with the graphics information (described 
later) inputted from the control unit 155, in accordance 

40 with an indication which it receives from the control unit 
155. The reproducing unit 153 outputs the reproduced 
image to the display unit 1 54. The reproducing unit 1 53 
also reproduces the stored audio information in syn- 
chronization with the reproduction display image infor- 

45 mation and outputs the reproduced audio to the audio 
output unit 157. 

The display unit 1 54 can be realized by a television 
monitor which displays images according to NTSC (Na- 
tional Television System Committee) standard, and is 

50 used to display the display image and cursor design on 
its screen, in accordance with the input from the repro- 
ducing unit 153. 

Structure of the Control Unit 155 

55 

The control unit 155 sets an initial value in the reg- 
ister storing a variable (described later), and instructs 
the separating unit 151 to fetch the display image infor- 



ms 



16 



31 



EP 0 810 790 A2 



32 



mation (including audio information) and link information 
of a page specified by this initial value, which as one 
example can be the identification number "0001 ". 

The control unit 155 instructs the reproducing unit 
153 to reproduce the display image information (includ- 
ing audio information), every time new display image in- 
formation (including audio information) is stored in the 
received data holding unit 152. Every time new link in- 
formation is stored in the received data holding unit 1 52, 
the control unit 155 interprets the link information and 
generates a cursor design correspondence table in 
which cursor designs (described later) are generated for 
each cursor display position. These cursor designs are 
expressed by cursor information which is held inside the 
control unit 1 55. The control unit 1 55 outputs design in- 
formation expressing a cursor design together with the 
cursor position to the reproducing unit 153, as well as 
indicating the reproduction of the cursor design. 

Fig. 1 6 shows an example of the cursor design cor- 
respondence table which the control unit 1 55 generates 
to control the display position of the cursor design. 

The cursor design correspondence table shows the 
correspondence between each cursor display position 
which is expressed in the hot spot information in the link 
information stored in the received data holding unit 152 
and the cursor number for the cursor design to be dis- 
played at each cursor display position. The control unit 
1 55 assigns cursor numbers to each cursor display po- 
sition in the link information in order of lowest Y coordi- 
nate and then lowest X coordinate, as one example, and 
writes each display position into the item with corre- 
sponding cursor number in the cursor design corre- 
spondence table. 

Fig. 17 shows an example of the design information 
stored by the control unit 155. As shown in Fig. 17, the 
control unit 155 stores cursor information which ex- 
presses a cursor design for each cursor number when 
the number is selected (referred to as the "selection 
state") and a cursor design for each number when the 
number is not selected (referred to as the "non-selection 
state"). 

On receiving an interrupt from the signal receiving 
unit 1 56, the control unit 1 55 interprets the type of input 
signal stored in the signal receiving unit 1 56, selects the 
design information of the corresponding cursor design, 
and outputs the cursor information to the reproducing 
unit 1 53. Following this, the control unit 1 55 controls the 
handling of the received data by the separating unit 1 51 , 
in accordance with the cursor whose selection has been 
confirmed. 

Display Control Procedure for the Received Data 

The following is a detailed explanation of the display 
control procedure by the control unit 1 55 for a set of re- 
ceived data, a set of received data referring to display 
image information (including audio information) and link 
information which have been stored in corresponding 



storage areas in the received data holding unit 152 by 
the separating unit 151 and which have the same iden- 
tification number. 

The control unit 155 sets a predetermined value, 

5 such as "1", into the variable "P-lndex" which expresses 
the identification number of the received data to be dis- 
played. The control unit 155 then sets a predetermined 
value, such as "1 ", into the variable "Cur-Pos" showing 
the cursor number which is in the selection state. Fol- 

10 lowing this, the control unit 155 instructs the separating 
unit 151 to obtain the transmission data indicated by the 
variable "P-lndex". The control unit 155 then interprets 
the link information in the received data which is re- 
ceived in accordance with this instruction and is stored 

is in the received data holding unit 152, and outputs the 
cursor information for each cursor, the cursor indicated 
by the variable Cur-Pos being in the selection state, to- 
gether with the display position to the reproducing unit 
153. Here, when an interrupt from the signal receiving 

20 unit 156 occurs, the control unit 155 interprets the con- 
trol signal stored in the signal receiving unit 156. First, 
the control unit 1 55 checks whether the input signal was 
"Up", in which case the control unit 155 decreases the 
value of variable Cur-Pos by 1. If not, the control unit 

25 155 checks whether the input signal was "Down", in 
which case the control unit 155 increases the value of 
variable Cur-Pos by 1 . If not, the control unit 1 55 checks 
whether the input signal was "Enter", in which case the 
control unit 155 finds the coordinates of the display po- 

30 sition from the cursor number given by the variable Cur- 
Pos, and obtains the identification number of the file 
which is the link destination file written in the hot spot 
information for these coordinates. The control unit 155 
then sets this identification number in the variable P-ln- 

35 dex, and instructs the separating unit 151 to obtain the 
transmission data shown by the variable P-lndex. 

Structure of the Signal Receiving Unit 156 andthe Audio 
Output Unit 157 

40 

On receiving an input signal from a remote control- 
ler (not-illustrated) or the like, the signal receiving unit 
156 creates an interrupt for the control unit 155 in ac- 
cordance with the received input signal, as well as hold- 
45 jng the received input signal. 

The audio output unit 157 can be realized by a 
speaker or the like, and is used to output the reproduced 
audio information as audio. 



Fig. 18 shows display image 1800 for the initial 
screen which is displayed by the display unit 1 54 based 
on the transmission data 800 shown in Figs. 8A to 8C. 
55 As shown in Fig. 1 8, the display image 1 800 has the 
cursor design 1 801 corresponding to cursor number "1 " 
displayed at a display position (100,600) indicated by 
the display image information 801, in accordance with 
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the hot spot information given on line 81 2 of the link in- 
formation 803. It should be noted here that the cursor 
information which represents the selection state has 
been selected for cursor design 1801 in accordance with 
the initial value of the variable Cur-Pos which is held by 
the control unit 155. 

In the same way, the cursor design 1801 corre- 
sponding to cursor number "2" is displayed at a display 
position (100,700), in accordance with the hot spot in- 
formation given on line 813 of the link information 803. 
It should be noted here that the cursor information which 
represents the non-selection state has been selected for 
cursor design 1 802 since its cursor number "2" does not 
coincide with the initial value of the variable Cur-Pos. 

Here, since the transmission data 800 includes au- 
dio information 802 in addition to the display image in- 
formation 801 , an audio commentary is outputted by the 
audio output unit 157 when the display image 1800 is 
displayed on the display unit 154. 

Fig. 19 shows the display image 1900 which is the 
initial screen displayed by the display unit 154 for the 
transmission data 900 shown in Figs.9A and 9B. 

As with the display image 1 800 in Fig. 1 8, the display 
image 1 900 has the cursor design 1 901 displayed at a 
display position (050,400) indicated by the display im- 
age information 901 , in accordance with the hot spot in- 
formation given on line 912 of the link information 902. 
Here, the cursor information for the selection state is se- 
lected as cursor design 1 901 . 

Fig. 20 shows the display image 2000 which is the 
initial screen displayed by the display unit 154 for the 
transmission data 1000 shown in Fig. 1 0A and 10B. 

As before, the display image 2000 has the cursor 
design 2001, which corresponds to cursor number "1" 
and which shows the selection state, displayed at a dis- 
play position (050,400) indicated by the display image 
information 1001 , in accordance with the hot spot infor- 
mation given on line 1012 of the link information 1002. 

Specific Example of the Procedure of the Control Unit 
155 

The following is an explanation of a specific exam- 
ple of the procedure executed by the control unit 155 
when displaying the display image 1 800 on the display 
unit 154 based on the transmission data 800. 

The control unit 1 55 first sets the initial value of the 
variable P-lndex at "0001" and the initial value of the 
variable Cur-Pos at "1". Next, the control unit 155 in- 
structs the separating unit 151 to obtain the display im- 
age information 801 (including the audio information 
802) and the link information 803 which have the iden- 
tification number "0001 " set in the variable P-lndex. The 
control unit 155 then instructs the reproducing unit 153 
to reproduce the display image information 801 (includ- 
ing audio information 802) stored in the received data 
holding unit 152. The reproducing unit 153 reproduces 
the display image information 801 and outputs it to the 



display unit 1 54 and simultaneously reproduces the au- 
dio information 802 which it outputs to the audio output 
unit 1 57. The control unit 1 55 interprets the link informa- 
tion 803 stored in the received data holding unit 152, 

5 generates a cursor design correspondence table, and 
outputs design information for each cursor and their dis- 
play positions to the reproducing unit 1 53. At this point, 
the cursor indicated by the variable Cur-Pos, which is to 
say the first cursor, is displayed in the selection state. 

10 The control unit 1 55 then waits for an input from the 
signal receiving unit 156. Here, suppose that a "Down" 
signal is inputted into the signal receiving unit 156 from 
an external remote controller. When the input signal is 
"Down", the control unit 155 increases the value of var- 

15 iable Cur-Pos by "1 ", making it "2". Next, the cursor in- 
formation for the selection state is selected as the de- 
sign for cursor number "2" which is indicated by this up- 
dated variable Cur-Pos, and the cursor information for 
the non-selection state is selected as the design for cur- 

20 sor number "1 " which was formerly indicated by the var- 
iable Cur-Pos ; with these sets of cursor information be- 
ing outputted to the reproducing unit 153. 

The control unit 155 waits for an interrupt from the 
signal receiving unit 156, with the following explanation 

25 describing the case when the signal receiving unit 156 
stores an input signal for a pressing of the "Enter" key 
after generating the interrupt. If the input signal is "En- 
ter", the control unit 155 reads the X-Y coordinates 
(100,700) corresponding to cursor number "2" which is 

30 indicated by the variable Cur-Pos from the cursor design 
correspondence table. Next, the control unit 155 reads 
the identification number of the link destination file of the 
hot spot information on line 813, based on these X-Y 
coordinates (100,700), and obtains the identification 

35 number "0003". Next, this identification number "0003" 
is set as the value of the variable P-lndex. Following this, 
the control unit 155 instructs the separating unit 151 to 
obtain the display image information 1001 and the link 
information 1002 which have the identification number 

40 indicated by this variable P-lndex. The control unit 155 
then resets the variable Cur-Pos to "1 ". 

By repeating the processing described above, the 
display image 2000 shown in Fig. 20 can be displayed 
on the display unit 1 54. Here, if an interrupt occurs when 

45 the value of the variable Cur-Pos is "1", and an input 
signal for "Enter" is being stored by the signal receiving 
unit 156 when the control unit 155 refers to the signal 
receiving unit 1 56, the control unit 1 55 will have the dis- 
play image 1900 shown in Fig. 19 displayed on the dis- 

50 play unit 154, as described above. 

Procedure for Display Control 

Fig. 21 is a flowchart showing an example proce- 
55 dure for display control which is performed by the control 
unit 155. 

The control unit 1 55 first sets the initial value of the 
variable P-lndex which indicates the identification 
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number of the transmission data to be obtained (step 
S2101). 

The control unit 1 55 then sets the initial value of the 
variable Cur-Pos which indicates the cursor number of 
the cursor in the selection state for the start of display 
of each display screen (step S2102). 

The control unit 155 then instructs the separating 
unit 151 to obtain the transmission data which has the 
identification number indicated by the variable P-lndex. 
The separating unit 151 then separates the display im- 
age information and link information in accordance with 
the indication from the control unit 155, and stores the 
display image information and link information with their 
identification number in the received data holding unit 
152 (step S2103). 

On being instructed by the control unit 155, the re- 
producing unit 153 reproduces the display image infor- 
mation in the received data holding unit 1 52 and outputs 
ittothe display unit 154. When there is audio information 
which is related to the display image information, the re- 
producing unit 153 reproduces this audio information 
and outputs it to the audio output unit 1 57 (S21 04). 

The control unit 155 interprets the link information 
in the received data holding unit 152 and outputs the 
design information for the cursor designs together with 
the X-Y coordinates for the display positions of the cur- 
sors, as well as an instruction to display the design in- 
formation to the reproducing unit 153. The reproducing 
unit 153 reproduces the design information inputted 
from the control unit 155 and outputs it to the display 
unit 154 (step S2105). By doing so, one display image 
is displayed by the display unit 154. 

The control unit 155 waits for an interrupt from the 
signal receiving unit 156 (step 52106), and on receiving 
an interrupt, checks whether the input signal held by the 
signal receiving unit 156 is "Up" (step S2107). 

If the input signal is "Up", the control unit 155 sub- 
tracts "1" from the value of the variable Cur-Pos (step 
S2108). If not, the control unit 155 checks whether the 
input signal held by the signal receiving unit 156 is 
"Down" (step S2109). 

If the input signal is "Down", the control unit adds 
"1 11 to the value of the variable Cur-Pos (step S211 0). If 
not, the control unit 1 55 checks whether the input signal 
held by the signal receiving unit 156 is "Enter" (step 
S2111). 

If the input signal in "Enter", the control unit 1 55 us- 
es the cursor number shown by the variable Cur-Pos to 
reference the cursor design correspondence table and 
so finds the cursor display position (X,Y) which it then 
uses to find the value of the identification number of the 
link destination file in the hot spot information. The con- 
trol unit 155 then sets this identification number as the 
value of the variable P-lndex. After this, the processing 
returns to S2102. 

If the input signal is not "Enter", the processing re- 
turns to S2106. 

As described above, in the present embodiment the 



display image information, which conventionally would 
have had to have been generated by the data receiving 
apparatus 150 while the data receiving apparatus 150 
is interpreting the control information, is generated and 

5 transmitted by the data transmitting apparatus 110, 
which reduces the load of each data receiving apparatus 
150. Also ; when compared with the large number and 
variety of display control processes for display character 
strings which were conventionally written into the control 

10 information, the link information of the present embodi- 
ment contains a smaller number and less variety of con- 
trol processes. As a result, simulated bidirectional com- 
munication can be easily achieved by the data receiving 
apparatuses 150 using this link information. 

is The present embodiment describes the case when 
in order to display WWW home pages on the Internet, 
the data communication system 100 uses a one-to- 
many TV broadcast to perform simulated bidirectional 
communication, so that when compared to the case 

20 when home pages are displayed by a browser on a per- 
sonal computer, the display of the user's desired pages 
on the display unit 1 54 can be performed at a high speed 
which is unaffected by congestion. Since display image 
information is sent in a conventional TV format, the dis- 

25 play of full color, high-resolution images can easily be 
achieved by the display unit 1 54. Also, while the display 
of display images generated by a browser for display on 
a TV monitor does not make full use of the components, 
such as the reproduction processing for display images, 

30 conventionally provided inside a TV, the present embod- 
iment can achieve simulated bidirectional communica- 
tion which makes full use of circuitry, such as memory 
and decoders, conventionally provided inside a TV set. 
In the present embodiment, while the information to 

35 be obtained has been described as HTML documents 
which are used on the WWW together with compressed 
image information in GIF format and audio information 
in AU format, information expressed in other formats or 
languages, such as HyperCards, can be used. In such 

40 case, the processing for "<A>" tags refer to a method 
for conversion for the corresponding format and lan- 
guage. The present embodiment also describes the 
conversion of an HTML document containing only a lim- 
ited number of tags, although other HTML tags may also 

45 be included. 

The present embodiment also describes an exam- 
ple where the control for simulated bidirectional commu- 
nication performed according to the link information is 
the switching of the display to another display image, 

50 although other processes, such as a process for flash ing 
display on the screen, a process for scrolling the display 
image, or a process for activating a device such as a 
fax, telephone, or video recorder connected to the data 
receiving apparatus, may be performed in addition to 

55 simulated bidirectional communication. 

The data communication system 100 is also de- 
scribed as having identification numbers of files written 
into the link information by the transmission data gener- 
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ating unit 112, although this process need not to be per- 
formed. As one alternative, the original file name may 
be written into the link information as the file identifica- 
tion number. When doing so, the file name can be at- 
tached to the display image information (including audio 
information) and link information in each set of transmis- 
sion data during transmission, with the data receiving 
apparatus 150 which receives this information succes- 
sively obtaining a complete set of link information after 
being switched on, so that it can then investigate the 
correspondence between file names and identification 
numbers. 

The data receiving apparatus 150 may also store a 
complete set of display image information and link infor- 
mation which are repeatedly transmitted by the data 
transmitting apparatus 110 in the received data holding 
unit 152. 

When the transport stream shown in Fig. 1 1 B is 
transmitted from the data transmitting apparatus 110, 
the receiving apparatus 150 may first have the separat- 
ing unit 151 separate and obtain the PMT, before read- 
ing the PMT to find the PID of the display image infor- 
mation to be obtained and having the display image in- 
formation separated and obtained from the transport 
stream with the read PI D as a filter condition. It may also 
read the PID of the private stream including the link in- 
formation from the PMT, and then separate and obtain 
the link information from the transport stream with the 
PID and the identification number (table ID extension) 
as the filter conditions. 

The transport stream shown in Fig.HB was also de- 
scribed as having a video elementary stream made up 
of I pictures, although the video elementary stream may 
include B pictures and P Pictures. The display image 
information was also described as being encoded ac- 
cording to MPEG2 standard, although it may alternative- 
ly be encoded under another standard, such as MPEG1 , 
JPEG, or GIF. Finally, the display image information and 
audio information were described as being transmitted 
as a video elementary stream and an audio elementary 
stream, although they may be multiplexed as private 
sections in the same way as the link information. 

Second Embodiment 

Fig. 22 is a block diagram showing the construction 
of the data communication system 2200 of the second 
embodiment of the present invention. It should be noted 
here that components which are the same as the first 
embodiment have been given the same reference nu- 
merals and will not be explained. 

The data communication system 2200 includes a 
data transmitting apparatus 2210 and a data receiving 
apparatus 2250. 

The data transmitting apparatus 2210 is equipped 
with a transmission data generating unit 2211 , in place 
of the transmission data generating unit 112 of the data 
transmitting unit 110. 



Each data receiving unit 2250 is equipped with a 
control unit 2251 in place of the control unit 155. This 
control unit 2251 includes a design information storing 
unit 2252. 

5 

Data Transmitting Apparatus 2210 

The transmission data generating unit 2211 is 
equipped with a data conversion table storing unit 2212 
10 in place of the data conversion table storing unit 122, 
although, with the exception of the link information table, 
the stored content of the data conversion table storing 
unit 2212 is the same as the data conversion table stor- 
ing unit 122. 

is Fig. 23 shows an example of the link information 
table 2300 which is the stored content of the data con- 
version table storing unit 2212. 

In addition to the index information 701 and the hot 
spot information 702, the link information table 2300 al- 

20 so shows the format of the title information 2301 . 

The title information 2301 is composed of an infor- 
mation identification part "TITLE" identifying the present 
information as title information, X-Y coordinates 
"X=999, Y-999" showing the title display position in the 

25 display screen in which the corresponding display im- 
age information is to be displayed, and a number of pix- 
els "L=999" which expresses the length of the title char- 
acter string on the display screen. Here, the title char- 
acter string length is expressed as a number of pixels, 

30 although it may alternatively be expressed as a number 
of characters. 

The transmission data generating unit 2211 gener- 
ates title information indicating the composition of the 
title supplementary design in accordance with the link 

35 information table in the data conversion table storing 
unit 2212, in addition to the processes performed by the 
transmission data generating unit 112. 

The following is a detailed description of the gener- 
ation process for title information performed by the 

40 transmission data generating unit 221 1 , using the HTML 
document 301 shown in Fig. 3. Note that the initial dis- 
play position which is set for each page in a WWW home 
page is (20,20). 

After generating the index information from the file 

45 name of the HTML document 301 , the transmission data 
generating unit 221 1 interprets the tag "<HTML>" on line 
311 and identifies that this is the first line of the HTML 
document 301. Following this, it deletes the character 
string "HTML" in the tag storage area. 

50 Next, the transmission data generating unit 2211 
reads the tag "<H1>" on line 312, looks up the tag 
"<H1 >" in the tag table, and sets the headline flag in the 
flag storage area of the work area. 

Since the headline flag is set in the flag storage ar- 

55 ea, the transmission data generating unit 2211 gener- 
ates title information and, in the same way as the trans- 
mission data generating unit 1 1 2, converts the character 
string "WEATHER REPORT" between the tag "<H1>" 
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and "</H1>" into image information using the H1 head- 
line font to generate display image information. 

More specifically, the transmission data generating 
unit 2211 refers to the link information table 2300 and 
finds the format of title information 2301 . In the present 
case, this format is "<TITLE X=999, Y=999, L=999>", of 
which "X=999, Y=999" are the X-Y coordinates of the 
display position of the title. The display position of the 
title "WEATHER REPORT" which is given between the 
"<H1>" tags in the HTML document 301 is the coordi- 
nate position (20,20). Here, "L=999" shows the length 
of this character string. Since this character string is 
fourteen characters long, if the dimensions of each char- 
acter in the H 1 headline font are (1 0,10), the length L of 
this character string will be "1 40". As a result, the trans- 
mission data generating unit 2211 will generate the title 
information "<TITLE X=020, Y-020, L=140>" and add it 
to the link information storage area of the transmission 
data holding unit 113. The processes performed after 
this are the same as Lhe transmission data generating 
unit 112, and so will not be explained. 

Figs.24A, 24B, and 24C showthe transmission data 
2400 for the first page of the WWW home page which 
is generated from the HTML document 301, the audio 
information "Weather.au", and the image information 
401. This transmission data 2400 is composed of dis- 
play image information 801, the audio information 802, 
and the link information 2401 . The content of Figs. 24A 
and 24B is the same as Figs. 8A and 8B, while Fig.24C 
shows the content of the link information 2401 which dif- 
fers from Fig. 8C. 

As shown in Fig.24C, the link information 2401 in- 
cludes title information which is written on line 241 2 after 
the index information on line 2411. Following this, the 
hot spot information is written on lines 2413 and 2414. 
This hot spot information is the same as the hot spot 
information on lines 812 and 81 3 of the link information 
803 given in Fig. 8C. 

Fig. 25 is a flowchart for an example of the proce- 
dure of the transmission data generating unit 2411 for 
an "<H1>" tag. 

In step S1408 shown in Fig. 15, the transmission 
data generating unit 2211 checks whether the tag is an 
"<H1>" tag (step S2501), and if not, the processing ad- 
vances to step 52512. 

If the tag is an "<H1>" tag, the transmission data 
generating unit 2211 sets the headline flag, calculates 
the coordinates of the title display position, and stores 
the calculated value in the appropriate registers as the 
title display position and as the next character display 
position (step S2502). 

The transmission data generating unit 2211 then 
checks whether a character string is being stored in the 
character string storage area (S2503) and if not, the 
processing advances to step S2509. If a character string 
is being stored in the character string storage area, the 
transmission data generating unit 2211 reads one char- 
acter from the character string storage area and deletes 



the character from the character string storage area 
(step S2504). The transmission data generating unit 
2211 then converts the character into an image using 
the H1 headline font (step S2505). Following this, the 

5 transmission data generating unit 2211 arranges the 
character image at the next character display position 
and generates display image information (step S2506). 
After adding the generated display image information to 
the display image information storage area (step 

10 S2507), the next character display position is updated 
in accordance with the character size of the H1 headline 
font (step S2508), before the processing returns to step 
S2503. 

Since all of the character strings in the character 
is string storage area have been converted into images, 
the transmission data generating unit 2211 calculates 
the title character string length by subtracting the coor- 
dinate value of the title display position from the coordi- 
nate position of the next character display position (step 
20 S2509). Next, the transmission data generating unit 
2211 generates the title information from the title char- 
acter string length and the coordinates of the title display 
position, in accordance with the format of the title infor- 
mation 2301 of the link information table 2300 (step 
25 S251 0), and adds the generated title information to the 
link information storage area (step S251 1 ). It then proc- 
esses the other tags as before (step S2512). 

Data Receiving Apparatus 2250 

30 

In addition to the processes of the control unit 1 55, 
the control unit 2251 outputs the title supplementary de- 
sign stored in the design information storing unit 2252 
to the reproducing unit 153 together with the X-Y coor- 
35 dinates showing the display position and the title char- 
acter string lenqth, in accordance with the title informa- 
tion in the link information. When doing so, the control 
unit 2251 instructs the reproducing unit 153 to repro- 
duce the title supplementary design in the current dis- 
40 play screen. As one example, the control unit 2251 may 
read and store the X-Y coordinates showing the display 
position for the title supplementary design and the title 
character string length from the title information every 
time new link information is stored in the received data 
45 holding unit 1 52. Additionally after instructing the repro- 
ducing unit 1 53 to reproduce the display image informa- 
tion, the control unit 2251 reads the title supplementary 
design from the design information storing unit 2252 and 
outputs the read information together with the display 
50 position (X-Y coordinates) for the title supplementary 
design and the title character string length to the repro- 
ducing unit 153. The control unit 2251 then indicates that 
the length of the title supplementary design should be 
set in accordance with the title character string length 
55 and that the title supplementary design should be com- 
bined with the display image for the display image infor- 
mation at the appropriate X-Y coordinates. This 
processing is performed between step S2104 and step 
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S2105 in Fig. 21. 

The design information storing unit 2252 stores title 
supplementary designs, in addition to the cursor de- 
signs. 

Fig. 26 shows an example of the stored content of 
the design information storing unit 2252. 

The design information storing unit 2252 stores cur- 
sor designs 2601 for the non-selection state, cursor de- 
signs 2602 for the selection state, and title supplemen- 
tary designs 2603. 

The cursor designs 2601 are read by the control unit 
2251 after referring to the cursor design correspond- 
ence table, and are displayed at the display positions 
which are not indicated by the cursor number given in 
the variable Cur-Pos. 

One of the cursor designs 2602 is also read by the 
control unit 2251 , having referred to the cursor design 
correspondence table ; and is displayed at the display 
position which is indicated by the cursor number given 
in the variable Cur-Pos. 

As shown in Fig. 26, the title supplementary design 
2603 is stored with its height having been set before- 
hand to correspond to the size of the H1 headline font, 
so that by adjusting their length in accordance with the 
title character string length and displaying the design 
2603 superimposed at the display position of the char- 
acter images of the H1 headline font, the text image dis- 
played using the H1 headline font will be surrounded by 
a dotted line. This title supplementary design 2603 is 
read in accordance with the information identification 
part "TITLE" in the title information. 

Fig. 27 shows the display screen 2700 for the first 
screen which is displayed in accordance with the trans- 
mission data 2400 shown in Figs. 24A, 24B, and 24C. 

As shown in Fig. 27, a text image for "WEATHER 
REPORT" which is the title and which has a title char- 
acter string length of "140" is displayed at the title display 
position (20,20) in the display screen 2700. This text im- 
age is displayed surrounded by the title supplementary 
design 2701 stored in the design information storing unit 
2252. 

The cursor design 2702 for "HOTSPOT2" is dis- 
played at the display position shown by the display po- 
sition for the cursor number shown in initial seL value of 
the variable Cur-Pos. The cursor design 2703 for 
"HOTSPOT1" is displayed at the other cursor display 
position. 

In addition to the effect of the data communication 
system 1 00 of the first embodiment, the data communi- 
cation system 2200 of the present embodiment enables 
the data receiving apparatus 2250 to display a unique 
title supplementary design on its display screen without 
a significant increase in the load of the data receiving 
apparatus 2250. 

There is af urther benefit in that with the present em- 
bodiment, the data communication apparatus 2200 in- 
dicates the display positions of the cursor designs in the 
hot spot information, with the data receiving apparatus 



2250 displaying cursor designs which it stores before- 
hand, so that the control for the display of cursor designs 
is performed at the receiver's end. As a result, the data 
transmitting apparatus 221 0 no longer needs to transmit 

5 the same content of display image information just to 
express a change in the selection state or non-selection 
state of cursor designs, thereby improving the efficiency 
of information transfer for the display image information. 
By storing design information for different designs 

10 jn different models of data receiving apparatuses 2250, 
for example, it becomes possible to customize the cur- 
sor designs for each model of data receiving apparatus 
2250. These customized designs can then be displayed 
to draw the user's attention to important display iLems 

is on the screen. Since a plurality of sets of design infor- 
mation can be stored in the data receiving apparatus, 
the user may select a desired set of cursors and have 
them displayed. 

It should be noted that the cursor design and the 

20 title supplementary design shown in Fig. 26 may be ex- 
pressed as bitmap data which is a grouping of pixels, or 
as vector graphics data which is composed of coordi- 
nate data showing the display positions of the lines 
which fundamentally compose the design. 

25 

Third Embodiment 

Fig. 28 is a block diagram showing the construction 
of the data communication system 3200 of the third em- 
30 bodiment of the present invention. It should be noted 
that components which are the same as the data com- 
munication system 2200 shown in Fig. 22 have been 
given the same reference numerals and will not be ex- 
plained. 

35 The data communication system 3200 is composed 
of a data transmitting apparatus 321 0 and a data receiv- 
ing apparatus 3250. 

The data transmitting apparatus 3210 is equipped 
with a supplementary design adding unit 3211 , in addi- 

40 tion to the construction of the data transmitting appara- 
tus 2210. 

The data receiving apparatus 3250 is equipped with 
a supplementary design obtaining unit 3253, in addition 
to the construction of the data receiving apparatus 2250. 
45 The design information stored in Fig. 26 is stored in 
an external database. 

Supplementary Design Adding Unit 3211 

50 The supplementary design adding unit 3211 reads 
the design information shown in Fig. 26 from an external 
database, and adds the read design information to the 
link information stored in the transmitted data holding 
unit 113. 

55 Figs. 29A to 29C show the transmission data 3400 
which includes the link information 3401 to which the 
design information shown in Fig. 26 has been added. 
This transmission data 3400 is composed of display im- 
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age information 801 , audio information 802, and link in- 
formation 3401 . Figs. 29A and 29B correspond to Figs. 
24A and 24B. Fig. 29C, meanwhile, shows the content 
of the link information 3401 . 

As shown in Fig. 29C, index information is written s 
on line 3411 of link information 3401 , title information is 
written on line 3412, and hot spot information is written 
on lines 341 3 and 341 4. Following this, design informa- 
tion 3415 is given. 

10 

Supplementary design obtaining unit 3253 

The supplementary design obtaining unit 3253 ob- 
tains only the design information from the link informa- 
tion stored in the received data holding unit 152 and 15 
stores it in the design information storing unit 2252 pro- 
vided in the control unit 2251. Following this, the sup- 
plementary design obtaining unit 3253 deletes the de- 
sign information from the link information stored in the 
transmitted data holding unit 152. 20 

In addition to the effects of the data communication 
system 2200, the data communication system 3200 of 
the present embodiment has the data transmitting ap- 
paratus 321 0 transmit design information obtained from 
an external database to the data receiving apparatus 25 
3250, so that the supplementary designs stored by the 
data receiving apparatus can be updated using a variety 
of different designs. 

Although the present invention has been fully de- 
scribed by way of examples with reference to accompa- 30 
nying drawings, it is to be noted that various changes 
and modifications will be apparent to those skilled in the 
art. Therefore, unless such changes and modifications 
depart from the scope of the present invention, they 
should be construed as being included therein. 35 



Claims 



2. A transmitting apparatus according to Claim 1, 
wherein said transmitting means includes: 

reading means for repeatedly reading said pre- 
determined number of frames of image data to- 
gether with said corresponding control informa- 
tion from said first and second storage means; 
multiplexing means for multiplexing image data 
and control information read by said reading 
means by transmitting said image data and 
control information in image sections and ver- 
tical blanking intervals, respectively, of a televi- 
sion signal; and 

output means for outputting the multiplexed tel- 
evision signal as an analog broadcast wave. 

3. A transmitting apparatus according to Claim 1, 
wherein said image data and control information 
stored in said first and second storage means are 
digitized, 

and wherein said transmitting means in- 
cludes: 

reading means for repeatedly reading said pre- 
determined number of frames of image data to- 
gether with said corresponding control informa- 
tion from said first and second storage means; 
multiplexing means for converting image data 
and control information read by said reading 
means into digital data streams, and multiplex- 
ing said digital data streams to produce a mul- 
tiplexed stream; and 

output means for outputting said multiplexed 
stream as a digital broadcast wave. 

4. A transmitting apparatus for an interactive com- 
munication system using a broadcast wave, com- 
prising: 



1. A transmitting apparatus for an interactive com- 40 
munication system using a broadcast wave, com- 
prising: 

first storage means for storing a plurality of 
frames of image data; 45 
second storage means for storing control infor- 
mation which shows links between said plural- 
ity of frames of image data stored in said first 
storage means, and which indicates a combin- 
ing of a supplementary design with the image so 
data stored in the first storage means, the sup- 
plementary design being stored by a receiving 
apparatus and being combined with an image 
represented by the image data; and 
transmitting means for repeatedly transmitting 55 
a predetermined number of frames of image 
data together with corresponding control infor- 
mation. 



first storage means for storing a plurality of 
frames of image data with an identifier allocated 
to each frame of image data; 
second storage means for storing control infor- 
mation for each frame of image data showing 
a link to another frame of image data stored in 
said first image storage means, the same iden- 
tifier being allocated to corresponding image 
data and control information, and said control 
information also indicating a combining of a 
supplementary design with the image data 
stored in the first storage means, the supple- 
mentary design is being stored by a receiving 
apparatus and being combined with an image 
represented by the image data; and 
transmitting means for repeatedly transmitting 
a predetermined number of frames of image 
data together with corresponding control infor- 
mation. 
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5. A transmitting apparatus according to Claim 4, 
wherein said control information includes identifiers 
allocated to linked image data. 

6. A transmitting apparatus according to Claim 5, s 
wherein said transmitting means includes: 

reading means for repeatedly reading all com- 
binations of image data and control information 
from said first and second storage means ; each 10 
combination including image data and control 
information with the same identifier; 
multiplexing means for multiplexing image data 
and control information read by said reading 
means by transmitting said image data and 15 
control information in image sections and ver- 
tical blanking intervals, respectively, of a televi- 
sion signal; and 

output means for outputting the multiplexed tel- 
evision signal as an analog broadcast wave. 20 

7. A transmitting apparatus according to Claim 6, 
wherein said multiplexing means allocates an im- 
age representing an identifier arranged at a fixed 
position in a non-displayed part of an image section. 25 

8. A transmitting apparatus according to Claim 5, 
wherein said transmitting means includes: 

reading means for repeatedly reading all com- 30 
binations of image data and control information 
from said first and second storage means ; each 
combination including one frame of image data 
and corresponding control information with the 
same identifier; 35 
multiplexing means for converting image data 
and control information read by said reading 
means into digital data streams, and multiplex- 
ing said digital data streams so as to produce 
a multiplexed stream; and 40 
output means for outputting said multiplexed 
stream as a digital broadcast wave. 

9. A transmitting apparatus according to Claim 8, 
wherein said multiplexing means includes: 45 

a converter for converting image data into a first 
digital data stream and control information into 
a second digital data stream; 
an ID allocating unit for allocating first identify- so 
ing information to said first digital data stream 
for identifying image data and second identify- 
ing information to said second data stream for 
identifying control information; 
a table producing unit for producing a mapping 55 
table showing the correspondence between 
said first identifying information and image data 
identifiers and the correspondence between 



said second identifying information and control 
information identifiers; and 
a multiplexing unitfor multiplexing said first dig- 
ital data stream, said second digital data 
stream, and said mapping table. 

10. A transmitting apparatus according to Claim 5, 
further comprising third storage means for storing 
audio data corresponding to said image data, the 
same identifiers being allocated to corresponding 
image data and audio data, 

wherein said transmitting means transmits 
audio data as well as image data. 

11. A transmitting apparatus according to claim 10, 
wherein said transmitting means includes: 

reading means for repeatedly reading all com- 
binations of image data, control information, 
and audio data from said first, second, and third 
storage means, each combination including im- 
age data, control information, and audio data 
with the same identifier; 

multiplexing means for multiplexing a combina- 
tion of image data, audio data, and control in- 
formation read by said reading means to pro- 
duce a television signal, said audio data being 
transmitted on a television audio signal, a plu- 
rality of frames of image data and control infor- 
mation being transmitted in the image section 
and vertical blanking interval, respectively, of a 
television image signal, and the number of 
transmitted frames of image data and control 
information depending on the reproducing time 
of the audio data; and 

output means for outputting the multiplexed tel- 
evision signal as an analog broadcast wave. 

1 2. A transmitting apparatus according to Claim 1 1 , 
wherein 

said multiplexing means allocates an image 
representing an identifier in a fixed position in a non- 
displayed part of said image section. 

1 3. A transmitting apparatus according to Claim 1 0, 
wherein said transmitting means comprises: 

reading means for repeatedly reading all com- 
binations of image data, control information, 
and audio data from said first, second, and third 
storage means, each combination including 
one frame of image data, control information, 
and audio data with the same identifier; 
multiplexing means for converting image data, 
audio data, and control information read by said 
reading means into digital data streams, and 
multiplying said digital data streams to produce 
a multiplexed stream; and 
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output means for outputting said multiplexed 
stream as a digital broadcast wave. 

1 4. A transmitting apparatus according to Claim 1 3, 
wherein said multiplexing means comprises: s 

a converter for converting image data into a first 
digital data stream, control information into a 
second data stream, and audio data into a third 
digital data stream; 10 
an ID allocating unit for allocating said first dig- 
ital data stream first identifying information to 
identify image data, said second digital data 
stream second identifying information to iden- 
tify control information, and said third digital da- 15 
ta stream third identifying information to identify 
audio data; 

a table producing unit for producing a mapping 
table showing the correspondence between 
said first identifying information and image data 20 
identifiers, the correspondence between said 
second identifying information and control in- 
formation identifiers, and the correspondence 
between said third identifying information and 
audio data identifiers; and 25 
a multiplexing unit for multiplexing said first, 
second, and third digital data streams, and said 
mapping table. 

1 5. A transmitting apparatus for an interactive com- 30 
munication system using a broadcast wave, com- 
prising: 

obtaining means for obtaining pieces of page 
information representing a page containing 35 
characters and images, said page information 
including link information to show a link to an- 
other page, character information , and image 
information; 

first producing means for producing one frame 
of image data containing characters and imag- 
es in accordance with said character informa- 
tion and image information included in a piece 
of page information: 

second producinq means for interpreting said 
link information included in said obtained page 
information and producing, for each frame of 
image data, control information including image 
link information about a link to another frame of 
image data and supplementary design combin- 
ing information indicating a combining of a sup- 
plementary design with the frame of image data 
generated by the first producing means, the 
supplementary design being stored by a receiv- 
ing apparatus and being combined with an im- 
age represented by the image data; 
first storage means for storing a predetermined 
number of frames of image data produced by 



said first producing means; 
second storage means for storing said control 
information produced by said second produc- 
ing means; and 

transmitting means for repeatedly transmitting 
said predetermined number of frames of image 
data together with said control information. 

1 6. A transmitting apparatus according to Claim 1 5, 
wherein 

said obtaining means obtains said page infor- 
mation from the World Wide Web on the Internet. 

1 7. A transmitting apparatus according to Claim 1 6, 
wherein the second producing means includes: 

determining means for determining a specific 
image part by interpreting layout information in 
said obtained page information; and 
generating means for generating supplementa- 
ry design combining information indicating a 
supplementary design which is related to the 
determined specific image part, 
wherein the page information also includes lay- 
out information showing a layout of characters 
and images. 

1 8. A transmitting apparatus according to Claim 1 7, 
wherein the determining means determines a head- 
line as the specified image part, and the generating 
means generates supplementary design combining 
information which indicates a combining of the spe- 
cific image part with a supplementary design for 
hold display. 



1 9. A transmitting apparatus according to Claim 18, 
wherein the supplementary design combining infor- 
mation includes a classification of the specific im- 
age part. 

40 

20. A transmitting apparatus according to Claim 18, 
wherein the supplementary design combining infor- 
mation includes coordinates indicating the specific 
image part. 

45 

21 . A transmitting apparatus according to Claim 18, 
wherein the second producing means includes: 

supplementary design storage means for stor- 
50 jng a supplementary design beforehand; and 

supplementary design adding means for read- 
ing a supplementary design from the supple- 
mentary design storage means and for adding 
the read supplementary design Lo Lhe stored 
55 control information. 

22. A transmitting apparatus according to Claim 21 , 
wherein the second producing means further in- 
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eludes supplementary design obtaining means for 
obtaining a supplementary design from outside and 
storing the obtained supplementary design in the 
supplementary design storage means. 

5 

23. A transmitting apparatus according to Claim 1 7, 
wherein the determining means determines one of 
a character and an image to which a link has been 
attached as the specific image part, and the gener- 
ating means generates supplementary design com- 10 
bining information indicating a combining of supple- 
mentary design, which shows that a link to another 
frame of image data is attached, with the specified 
image part. 

15 

24. A transmitting apparatus according to Claim 23, 
wherein the determining means determines one of 
a character and an image to which a link has been 
attached as the specific image part, and the gener- 
ating means generates supplementary design com- 20 
bining information indicating a combining of supple- 
mentary design, which shows that a link to another 
frame of image data is attached, with the specified 
image part. 

25 

25. A transmitting apparatus according to Claim 23, 
wherein the supplementary design combining infor- 
mation includes coordinates indicating the specific 
image part. 

30 

27. A transmitting apparatus according to Claim 26, 
wherein the second producing means further in- 
cludes supplementary design obtaining means for 
obtaining a supplementary design from outside and 
storing the obtained supplementary design in the 35 
supplementary design storage means. 

28. A transmitting apparatus according to Claim 1 7, 
wherein the second producing means includes: 

40 

supplementary design storage means for stor- 
ing a supplementary design beforehand; and 
supplementary design adding means for read- 
ing a supplementary design from the supple- 
mentary design storage means and for adding 45 
the read supplementary design to the stored 
control information. 

29. A transmitting apparatus according to Claim 28, 
wherein the second producing means further in- so 
eludes supplementary design obtaining means for 
obtaining a supplementary design from outside and 
storing the obtained supplementary design in the 
supplementary design storage means. 

55 

30. A transmitting apparatus according to Claim 29, 
wherein the determining means determines a head- 
line as the specified image part, and the generating 



means generates supplementary design combining 
information which indicates a combining of the spe- 
cific image part with a supplementary design for 
bold display. 

31 . A transmitting apparatus according to claim 30, 
wherein the supplementary design combining infor- 
mation includes a classification of the specific im- 
age part. 

32. A transmitting apparatus according to Claim 30, 
wherein the supplementary design combining infor- 
mation includes coordinates indicating the specific 
image part. 

34. A transmitting apparatus according to Claim 33, 
wherein the supplementary design combining infor- 
mation includes a classification of the specific im- 
age part. 

35. A transmitting apparatus according to Claim 33, 
wherein the supplementary design combining infor- 
mation includes coordinates indicating the specific 
image part. 

36. A transmitting apparatus according to Claim 15, 
wherein the second producing means includes: 

determining means for interpreting layout infor- 
mation in said obtained page information and 
determining a specific image part; and 
generating means for generating supplementa- 
ry design combining information indicating a 
supplementary design which is related to the 
determined specific image part, 
wherein the page information also includes lay- 
out information showing a layout of characters 
and images. 

37. A transmitting apparatus according to Claim 36, 
wherein the determining means determines the 
specified image part as a headline, and the gener- 
ating means generates supplementary design com- 
bining information which indicates a combining of 
the specific image part with a supplementary design 
for bold display. 

38. A transmitting apparatus according to Claim 37, 
wherein the supplementary design combining infor- 
mation includes a classification of the specific im- 
age part. 

39. A transmitting apparatus according to Claim 37, 
wherein the supplementary design combining infor- 
mation includes coordinates for determining the 
specific image part. 

40. A transmitting apparatus according to Claim 37, 
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wherein the second producing means includes: 

supplementary design storage means for stor- 
ing a supplementary design beforehand; and 
supplementary design adding means for read- s 
ing a supplementary design from the supple- 
mentary design storage means and for adding 
the read supplementary design to the stored 
control information. 

10 

41 . A transmitting apparatus according to Claim 40, 
wherein the second producing means further in- 
cludes supplementary design obtaining means for 
obtaining a supplementary design from outside and 
storing the obtained supplementary design in the 15 
supplementary design storage means. 

42. A transmitting apparatus according to Claim 36, 
wherein the determining means determines one of 

a character and an image to which a link has been 20 
attached as the specific image part, and the gener- 
ating means generates supplementary design com- 
bining information indicating a combining of supple- 
mentary design, which shows that a link to another 
frame of image data is attached, to the specified im- 25 
age part. 

44. A transmitting apparatus according to Claim 42, 
wherein the supplementary design combining infor- 
mation includes coordinates indicating the specific 30 
image part. 

45. A transmitting apparatus according to Claim 42, 
wherein the second producing means includes: 

35 

supplementary design storage means for stor- 
ing a supplementary design beforehand; and 
supplementary design adding means for read- 
ing a supplementary design from the supple- 
mentary design storage means and for adding 40 
the read supplementary design to the stored 
control information. 

46. A transmitting apparatus according to Claim 45, 
wherein the second producing means further in- 45 
eludes supplementary design obtaining means for 
obtaining a supplementary design from outside and 
storing the obtained supplementary design in the 
supplementary design storage means. 

50 

47. A transmitting apparatus according to Claim 36, 
wherein the second producing means includes: 

supplementary design storage means for stor- 
ing a supplementary design beforehand; and 55 
supplementary design adding means for read- 
ing a supplementary design from the supple- 
mentary design storage means and for adding 



the read supplementary design to the stored 
control information. 

48. A transmitting apparatus according to Claim 47, 
wherein the second producing means further in- 
cludes supplementary design obtaining means for 
obtaining a supplementary design from outside and 
storing the obtained supplementary design in the 
supplementary design storage means. 

50. A transmitting apparatus according to Claim 49, 
wherein the supplementary design combining infor- 
mation includes a classification of the specific im- 
age part. 

52. A transmitting apparatus according to Claim 48, 
wherein the determining means determines one of 
a character and an image to which a link has been 
attached as the specific image part, and the gener- 
ating means generates supplementary design com- 
bining information indicating a combining of supple- 
mentary design, which shows that a link to another 
frame of image data is attached, with the specified 
image part. 

53. A transmitting apparatus according to Claim 52, 
wherein the determining means determines one of 
a character and an image to which a link has been 
attached as the specific image part, and the gener- 
ating means generates supplementary design com- 
bining information indicating a combining of supple- 
mentary design, which shows that a link to another 
frame of image data is attached, with the specified 
image part. 

55. A transmitting apparatus according to Claim 1 5, 
wherein said first producing means allocates iden- 
tifiers to image data, 

said second producing means allocates said 
identifiers to control information corresponding 
to said image data, 

said first and second storage means store said 
image data and control information together 
with said identifiers, and 
said control information is represented by said 
identifiers of linked image data. 

56. A transmitting apparatus according to Claim 55, 
wherein said transmitting means includes: 

reading means for repeatedly reading all com- 
binations of image data and control information 
from said first and second storage means, each 
combination including one frame of image data 
and control information with the same identifier; 
multiplexing means for multiplexing image data 
and control information read by said reading 
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means by transmitting said image data and 
control information in the image section and 
vertical blanking interval, respectively, of a tel- 
evision signal; and 

output means for outputting the multiplexed tel- s 
evision signal as an analog broadcast wave. 

57. A transmitting apparatus according to Claim 56, 
wherein said multiplexing means transmits an im- 
age representing an identifier in a fixed position in 10 
a non-displayed part of said image data. 

58. A transmitting apparatus according to Claim 55, 
wherein said transmitting means includes: 

15 

reading means for repeatedly reading all com- 
binations of image data and control information 
from said first and second storage means ; each 
combination including one frame of image data 
and corresponding control information; 20 
multiplexing means for converting image data 
into a first digital data stream and control infor- 
mation read by said reading means into a sec- 
ond digital data stream, and multiplexing said 
digital data streams so as to produce a multi- 25 
plexed stream; and 

output means for outputting said multiplexed 
stream as a digital broadcast wave. 

59. A transmitting apparatus according to Claim 58, 30 
wherein said multiplexing means includes: 

a converter for converting image data into a first 
digital data stream and control information into 
a second digital data stream; 35 
an ID allocating unit for allocating first identify- 
ing information to said first digital data stream 
for identifying image data and second identify- 
ing information to said second digital data 
stream for identifying control information; 40 
a table producing unit for producing a mapping 
table showing the correspondence between 
said first identifying information and image data 
identifiers and the correspondence between 
said second identifying information and control 45 
information identifiers; and 
a multiplexing unitfor multiplexing said first dig- 
ital data stream, said second digital data 
stream, and said mapping table. 

50 

60. A transmitting apparatus according to Claim 55, 
further comprising: 

third producing means for producing audio data 
according to audio information contained in 55 
said page information, and allocating said iden- 
tifiers to said audio data corresponding to said 
image data; and 



third storage means for storing said audio data 
together with said identifiers, 
wherein said transmitting means transmits said 
audio data as well as said image data. 

61 . A transmitting apparatus according to Claim 60, 
wherein said transmitting means includes: 

reading means for repeatedly reading all com- 
binations of image data, audio data, and control 
information from said first, second, and third 
storage means, each combination including im- 
age data, audio data, and control information 
with the same identifier; 
multiplexing means for multiplexing one combi- 
nation of image data, audio data, and control 
information read by said reading means to pro- 
duce a television signal, said audio data being 
transmitted on a television audio signal, a plu- 
rality of frames of image daLa and control infor- 
mation required for reproducing said audio data 
being transmitted in the image section and ver- 
tical blanking interval, respectively, of a televi- 
sion image signal; and 

output means for outputting the multiplexed tel- 
evision signal as an analog broadcast wave. 

62. A transmitting apparatus according to Claim 61 , 
wherein said multiplexing means transmits an iden- 
tifier representing an image in a fixed position in a 
non-displayed part of said image section. 

63. A transmitting apparatus according to Claim 60, 
wherein said transmitting means includes: 

reading means for repeatedly reading all com- 
binations of image data, audio data, and control 
information from said first, second, and third 
storage means, each combination including im- 
age data, audio data, and control information 
with the same identifier; 
multiplexing means for converting image data, 
audio data, and control information read by said 
reading means into digital data streams, and 
multiplexing said digital data streams so as to 
produce a multiplexed stream; and 
output means for outputting said multiplexed 
streams as a digital broadcast wave. 

64. A transmitting apparatus according to Claim 63, 
wherein said multiplexing means includes: 

a converter for converting image data into a first 
digital data stream, control information into a 
second digital data stream, and audio data into 
a third digital data stream; 
an ID allocating unit for allocating first identify- 
ing information to said first digital data stream 
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to identify image data, second identifyinq infor- 
mation to said second digital data stream to 
identify control information, and third identifying 
information to said third digital data stream to 
identify audio data; 5 
a table producing unit for producing a mapping 
table showing the correspondence between 
said first identifying information and image data 
identifiers, the correspondence between said 
second identifying information and control in- 10 
formation identifiers, and the correspondence 
between said third identifying information and 
audio data identifiers; and 
a multiplexing unit for multiplexing said first, 
second, and third digital data streams, and said 15 
mapping table. 

65. A receiving apparatus for an interactive commu- 
nication system using a broadcast wave, wherein 
said broadcast wave is produced by multiplexing a 20 
plurality of frames of image data, and control infor- 
mation which includes image link information for 
each frame of image data showing links with other 
frames of image data and supplementary design 
combining information indicating the combining of 25 
a supplementary design with said plurality of frames 

of image data, said broadcast wave being repeat- 
edly transmitted, and said supplementary design 
being combined with an image of the image data, 

wherein said receiving apparatus comprises: 30 

separating means for separating a frame of im- 
age data and corresponding control information 
from said broadcast wave; 

supplementary design storage means for stor- 35 
ing at least one supplementary design; 
supplementary design reading means for read- 
ing a supplementary design from the supple- 
mentary design storage means, based on the 
separated control information; 40 
combining means for combining the read sup- 
plementary design with the separated image 
data; 

storage means for storing said combined image 
data and separated control information; 45 
reproducing means for reproducing said stored 
image data to output an image signal; 
operation means for receiving an operation in- 
struction from a user to switch image data; and 
control means for controlling said separating so 
means to separate another frame of image data 
designated by said control information stored 
in said storage means according to said oper- 
ation instruction. 

55 

66. A receiving apparatus according to Claim 65, 
wherein the supplementary design combining 



information includes information indicating a 
combining of a supplementary design with a 
specific image part and a classification of the 
specific image part, 

wherein the supplementary design reading 
means includes: 

determining means for determining the 
classification in the supplementary design 
combining information included in the con- 
trol information separated by the separat- 
ing means: and 

supplementary design specifying means 
for specifying a supplementary design in 
the supplementary design storage means 
which corresponds to the determined clas- 
sification. 

67. A receiving apparatus according to Claim 66, 
wherein the classification indicates a headline as 
the specific image part and the supplementary de- 
sign specifying means specifies a supplementary 
design which emphasizes the specific image part. 

68. A receiving apparatus according to Claim 67, 

wherein the supplementary design combining 
information includes coordinate information in- 
dicating the specific image part, 
wherein the determining means reads the co- 
ordinate information; and 
wherein the combining means combines the 
image data and the supplementary design 
based on the read coordinate information. 

69. A receiving apparatus according to Claim 68, 

wherein the supplementary design is an image 
of a rectangle, 

wherein the combining means includes supple- 
mentary design converting means for convert- 
ing the size of the supplementary design so that 
the rectangle surrounds the headline, 
and wherein the combining means combines 
the converted supplementary design and the 
image data. 

70. A receiving apparatus according to Claim 66, 
wherein the classification indicates one of a char- 
acter and image to which a link has been attached 
as the specific image part and wherein the supple- 
mentary design specifying means specifies a sup- 
plementary design which shows that the specific im- 
age part has an attached link to other image data. 

71. A receiving apparatus according to Claim 70, 
wherein the supplementary design combining infor- 
mation includes coordinate information indicating 
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the specific image part, 

wherein the determining means reads the co- 
ordinate information; and 

wherein the combining means combines the s 
image data and the supplementary design 
based on the read coordinate information. 

72. A receiving apparatus according to Claim 71 , 

10 

wherein the supplementary designs stored in 
the supplementary design storage means 
which are used for showing that a link to other 
image data is attached are composed of two 
types which respectively correspond to a selec- 15 
tion and a non-selection state, 
wherein the operation means receives a selec- 
tion operation from the user for one of a char- 
acter and an image to which a link is attached, 
wherein the receiving apparatus includes state 20 
storage means for storing a selection or non- 
selection state in accordance with an instruc- 
tion from the operation means, and 
wherein the supplementary design reading 
means reads a supplementary design corre- 25 
sponding to a state stored in the state storage 
means from the supplementary design storage 
means. 

73. A receiving apparatus according to Claim 65, 30 

wherein the control information received from 
a transmitting apparatus further includes a sup- 
plementary design, and 

wherein the receiving apparatus further com- 35 
prises supplementary design recording means 
for recording a supplementary design included 
in the separated control information in the sup- 
plementary design storage means. 

40 

74. A receiving apparatus according to Claim 65, 

wherein the supplementary design storage 
means includes a plurality of supplementary 
designs, 45 
wherein the receiving apparatus further com- 
prises supplementary design selecting means 
for selecting one supplementary design from 
the plurality of supplementary designs stored 
by the supplementary design storage means, so 
in accordance with a user operation, and 
wherein the supplementary design reading 
means reads the selected supplementary de- 
sign. 

55 

75. A receiving apparatus according to Claim 65, 
wherein the identifier allocated to af rame of im- 



age data is the same as the identifier allocated 
to corresponding control information, 
wherein said control information expresses the 
identifier allocated to linked image data, 
wherein said separating means includes: 

first detecting means for detecting said 
identifier allocated to said image data; 
second detecting means for detecting said 
identifier allocated to said control informa- 
tion; and 

obtaining means for obtaining said image 
data and control information if said first and 
second detecting means have detected 
said identifiers, 

and wherein said storage means stores 
said image data and control information 
obtained by said obtaining means. 

76. A receiving apparatus according to Claim 75, 

wherein image data and control information are 
transmitted in the image section and vertical 
blanking interval, respectively, of a television 
signal as a multiplexed analog broadcast wave, 
wherein an identifier to be shown as an image 
is transmitted in a fixed position in non-dis- 
played part of said image section, and 
wherein said first judging means recognizes an 
identifier from an image in a fixed position in 
said non-displayed part. 

77. A receiving apparatus according to Claim 65, 

wherein the same identifier is allocated to im- 
age data and corresponding control informa- 
tion, 

wherein said image data and control informa- 
tion are converted into digital data streams to 
be multiplexed to transmit a multiplexed stream 
as a multiplexed digital broadcast wave, 
wherein said digital data streams are allocated 
first identifying information to identify image da- 
ta and second identifying information to identify 
control information, 

wherein said multiplexed stream comprises 
said digital data streams and a mapping table 
showing the correspondence between said first 
identifying information and image data identifi- 
ers and the correspondence between said sec- 
ond identifying information and control informa- 
tion identifiers, said digital data streams and 
said mapping table being multiplexed, 
wherein said storage means stores a mapping 
table separated by said separating means, 
wherein said control means recognizes an 
identifier of linked image data indicated by con- 
trol information, converts said identifier into first 
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identifying information and second identifying 
information referring to a mapping table, and 
sets said first identifying information and sec- 
ond identifying information to said separating 
means, 5 
and wherein said separating means includes: 

first detecting means for detecting said first 
identifying information from said multi- 
plexed stream; 10 
second detecting means for detecting said 
second identifying information from said 
multiplexed stream; and 
obtaining means for obtaining image data 
and control information indicated by said 15 
first and said second identifying informa- 
tion detected by said first and second de- 
tecting means. 

78. A receiving apparatus according to Claim 65, 20 

wherein said control information is expressed 
by at least one combination of a coordinate 
showing image part in image data correspond- 
ing to said control information, and the identifier 25 
allocated to linked image data ; 
wherein said operation means receives an op- 
eration instruction to designate said image part 
in image data, 

and wherein said control means reads the iden- 30 
tifier allocated to linked image data correspond- 
ing to said designated image region, and sets 
said identifier to said separating means. 

79. A receiving apparatus for an interactive commu- 35 
nication system using a broadcast wave produced 

by multiplexing a plurality of frames of image data, 
control information which includes image link infor- 
mation for each frame of image data showing links 
with other frames of image data and supplementary 40 
design combining information indicating the com- 
bining of a supplementary design with said plurality 
of frames of image data, and audio data corre- 
sponding to said plurality of frames of image data, 
said broadcast wave being repeatedly transmitted, 45 
and said supplementary design being combined 
with an image represented by the image data, 
wherein the receiving apparatus comprises: 

separating means for separating a frame of im- so 
age data and corresponding control information 
and audio data from said broadcast wave; 
supplementary design storage means for stor- 
ing at least one supplementary design; 
supplementary design reading means for read- 55 
ing a supplementary design from the supple- 
mentary design storage means, based on the 
separated control information; 



combining means for combining the read sup- 
plementary design with the separated image 
data; 

storage means for storing said combined image 
data and separated control information and au- 
dio data; 

reproducing means for reproducing said stored 
image data and audio data to output an image 
signal and an audio signal; 
operation means for receiving an operation in- 
struction to switch image data; and 
control means for controlling said separating 
means to separate another frame of image data 
designated by said control information stored 
in said storage means according to said oper- 
ation instruction. 

80. A receiving apparatus according to Claim 79, 

wherein the identifier allocated to a frame of im- 
age data is the same as the identifier allocated 
to corresponding control information, 
wherein said control information expresses the 
identifier allocated to linked image data, 
wherein said separating means includes: 

first detecting means for detecting said 
identifier allocated to said image data; 
second detecting means for detecting said 
identifier allocated to said control informa- 
tion; and 

obtaining means for obtaining said image 
data and control information if said first and 
second detecting means have detected 
said identifiers, 

and wherein said storage means stores said 
image data and control information obtained by 
said obtaining means. 

81. A receiving apparatus according to Claim 80, 

wherein said separating meansfurther includes 
audio separating means for separating audio 
data corresponding to said image data, and 
wherein said storage means stores said audio 
data separated by said audio separating 
means. 

82. A receiving apparatus according to Claim 79, 

wherein image data and control information are 
transmitted in the image section and vertical 
blanking interval, respectively, of a television 
image signal as a multiplexed analog broadcast 
wave, while audio data are transmitted as a tel- 
evision audio signal, 

wherein an identifier to be shown as an image 
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is transmitted in a fixed position in non-dis- 
played part of said image section, and 
wherein said first detecting means recognizes 
an identifier from an image in a fixed position 
of said non-displayed part. s 

83. A receiving apparatus according to Claim 79, 

wherein the same identifier is allocated to im- 
age data and corresponding control information 10 
and audio data, 

wherein said image data, audio data and con- 
trol information are converted into digital data 
streams to be multiplexed to transmit a multi- 
plexed stream as a multiplexed digital broad- 15 
cast wave, 

wherein said digital data streams are allocated 
first identifying information to identify image da- 
ta, second identifying information to identify 
control information, and third identifying infor- 20 
mation to identify audio information, 
wherein said multiplexed stream comprises 
said digital data streams and a mapping table 
showing the correspondence between said first 
identifying information and image data identifi- 25 
ers, the correspondence between said second 
identifying information and control information 
identifiers, and the correspondence between 
said third identifying information and audio in- 
formation identifiers, said digital data streams 30 
and said mapping table being multiplexed, 
wherein said storage means stores a mapping 
table separated by said separating means, 
wherein said control means recognizes an 
identifier of linked image data indicated by con- 35 
trol information, converts said identifier into first 
identifying information, second identifying in- 
formation and third identifying information by 
referring to a mapping table, and sets said first 
identifying information, second identifying in- 40 
formation, and third identifying information in 
said separating means, 
and wherein said separating means includes: 

first detecting means for detecting said first 45 
identifying information from said multi- 
plexed stream; 

second detecting means for detecting said 
second identifying information from said 
multiplexed stream; and so 
second detecting means for detecting said 
second identifying information from said 
multiplexed stream; and 
third detecting means for detecting said 
third identifying information from said mul- 55 
tiplexed stream; and 

obtaining means for obtaining image data, 
audio data, and control information indicat- 



ed by said first, second and third identifying 
information detected by said first, second, 
and third detecting means. 

84. A receiving apparatus according to Claim 79, 

wherein said control information is expressed 
by at least one combination of a coordinate 
showing image part in image data correspond- 
ing to said control information, and the identifier 
allocated to linked image data, 
wherein said operation means receives an op- 
eration instruction from a user to designate said 
image part in image data, and 
wherein said control means reads the identifier 
allocated to lin ked image data corresponding to 
said designated image region, and sets said 
identifier to said separating means. 

85. A receiving method used in a receiving appara- 
tus for an interactive communication system using 
a broadcast wave produced by multiplexing a plu- 
rality of frames of image data and control informa- 
tion including link information showing a link to an- 
other of said plurality of frames of image data and 
supplementary design combining information for 
each frame of image data indicating a combining of 
a supplementary design and the image data, the 
supplementary design being combined with an im- 
age represented by the image data, 

wherein said receiving method comprises: 

a separating step for separating a frame of im- 
age data and corresponding control information 
from said broadcast wave; 
a supplementary design reading step for read- 
ing a supplementary design stored in a memo- 
ry; 

a combining step for combining the read sup- 
plementary design and the image data; 
a storage step for storing said combined image 
daLa and said separated control information in 
a memory; 

a reproducing step for reproducing said image 
data stored in the memory to output an image 
signal; 

a operation step for receiving a user operation 
instruction to switch image data; 
a determining step for determining image data 
indicated by said control information stored in 
a memory according to said operation instruc- 
tion; and 

a second separating step for separating said 
determined image data and corresponding 
control information from said broadcast wave. 

86. A recording medium for recording a receiving 
program used in a receiving apparatus for an inter- 
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active communication system using a broadcast 
wave produced by multiplexing a plurality of frames 
of image data and control information including link 
information showing a link to another of said plural- 
ity of frames of image data and supplementary de- s 
sign combining information for each frame of image 
data which indicates a combining of a supplemen- 
tary design with the image data, the supplementary 
design being combined with an image represented 
by the image data, 10 

wherein the receiving program comprises the 
steps of: 

a separating step for separating a frame of im- 
age data and corresponding control information 15 
from said broadcast wave; 
a supplementary design reading step for read- 
ing a supplementary design stored in a memo- 
ry; 

a combining step for combining the read sup- 20 
plementary design and the image data; 
a storage step for storing said combined image 
data and said separated control information in 
a memory; 

a reproducing step for reproducing said image 25 
data stored in the memory to output an image 
signal; 

a operation step for receiving a user operation 
instruction to switch image data; 
a determining step for determining image data 30 
indicated by said control information stored in 
a memory according to said operation instruc- 
tion; and 

a second separating step for separating said 
determined image data and corresponding 35 
control information from said broadcast wave. 

87. An interactive communication system using a 
broadcast wave, comprising a transmitting appara- 
tus and a receiving apparatus, 40 
said transmitting apparatus comprising: 

first storage means for storing a plurality of 
frames of image data; 

second storage means for storing control infor- 45 
mation which shows links between said plural- 
ity of frames of image data stored in said first 
storage means, and which indicates a combin- 
ing of a supplementary design with the image 
data stored in the first storage means, the sup- so 
plementary design being stored by a receiving 
apparatus and being combined with an image 
represented by the image data; and 
transmitting means for repeatedly transmitting 
a predetermined number of frames of image 55 
data together with corresponding control infor- 
mation, 



and said receiving apparatus comprising: 

separating means for separating a frame of im- 
age data and corresponding control information 
from said broadcast wave; 
supplementary design storage means for stor- 
ing at least one supplementary design; 
supplementary design reading means for read- 
ing a supplementary design from the supple- 
mentary design storage means, based on the 
separated control information; 
combining means for combining the read sup- 
plementary design with the separated image 
data; 

storage means for storing said combined image 
data and separated control information; 
reproducing means for reproducing said stored 
image data to output an image signal; 
operation means for receiving an operation in- 
struction from a user to switch image data; and 
control means for controlling said separating 
means to separate another frame of image data 
designated by said control information stored 
in said storage means according to said oper- 
ation instruction. 

88. An interactive communication system according 
to Claim 87, wherein the transmitting means in- 
cludes: 

reading means for repeatedly reading said pre- 
determined number of frames of image data to- 
gether with said corresponding control informa- 
tion from said first and second storage means; 
multiplexing means for multiplexing image data 
and control information read by said reading 
means by transmitting said image data and 
control information in image sections and ver- 
tical blanking intervals, respectively, of a televi- 
sion signal; and 

output means for outputting the multiplexed tel- 
evision signal as an analog broadcast wave. 

89. An interactive communication system according 
to Claim 87, wherein said image data and control 
information stored in said first and second storage 
means are digitized, 

and wherein said transmitting means in- 
cludes: 

reading means for repeatedly reading said pre- 
determined number of frames of image data to- 
gether with said corresponding control informa- 
tion from said first and second storage means; 
multiplexing means for converting image data 
and control information read by said reading 
means into digital data streams, and multiplex- 
ing said digital data streams to produce a mul- 
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tiplexed stream; and 

output means for outputting said multiplexed 
stream as a digital broadcast wave. 

90. An interactive communication system using a s 
broadcast wave, comprising a transmitting appara- 
tus and a receiving apparatus, 

wherein said transmitting apparatus compris- 
es: 

10 

first storage means for storing a plurality of 
frames of image data with an identifier allocated 
to each frame of image data; 
second storage means for storing control infor- 
mation for each frame of image data showing 15 
a link to another frame of image data stored in 
said first image storage means, the same iden- 
tifier being allocated to corresponding image 
data and control information, and said control 
information also indicating a combining of a 20 
supplementary design with the image data 
stored in the first storage means, the supple- 
mentary design is being stored by a receiving 
apparatus and being combined with an image 
represented by the image data; and 25 
transmitting means for repeatedly transmitting 
a predetermined number of frames of image 
data together with corresponding control infor- 
mation, 

30 

and said receiving apparatus comprises: 

separating means for separating a frame of im- 
age data and corresponding control information 
from said broadcast wave; 35 
supplementary design storage means for stor- 
ing at least one supplementary design: 
supplementary design reading means for read- 
ing a supplementary design from the supple- 
mentary design storage means, based on the 40 
separated control information; 
combining means for combining the read sup- 
plementary design with the separated image 
data; 

storage means for storing said combined image 45 
data and separated control information; 
reproducing means for reproducing said stored 
image data to output an image signal; 
operation means for receiving an operation in- 
struction from a user to switch image data; and so 
control means for controlling said separating 
means to separate another frame of image data 
designated by said control information stored 
in said storage means according to said oper- 
ation instruction. 55 

91 . An interactive communication system according 
to Claim 90, 



wherein said control information is represent- 
ed by said identifiers of linked image data, 

and wherein said separating means includes: 

first detecting means for detecting said identifi- 
er allocated to said image data; 
second detecting means for detecting said 
identifier allocated to said control information; 
and 

obtaining means for obtaining said image data 
and control information if said first and second 
detecting means have detected said identifiers. 

92. An interactive communication system using a 
broadcast wave, comprising a transmitting appara- 
tus and a receiving apparatus, 

wherein the transmitting apparatus compris- 
es: 

obtaining means for obtaining pieces of page 
information representing a page containing 
characters and images, said page information 
including link information to show a link to an- 
other page, character information, and image 
information; 

first producing means for producing one frame 
of image data containing characters and imag- 
es in accordance with said character informa- 
tion and image information included in a piece 
of page information; 

second producing means for interpreting said 
link information included in said obtained page 
information and producing, for each frame of 
image data, control information including image 
link information about a link to another frame of 
image data and supplementary design combin- 
ing information indicating a combining of a sup- 
plementary design with the frame of image data 
generated by the first producing means, the 
supplementary design being stored by a receiv- 
ing apparatus and being combined with an im- 
age represented by the image data; 
first storage means for storing a predetermined 
number of frames of image data produced by 
said first producing means; 
second storage means for storing said control 
information produced by said second produc- 
ing means; and 

transmitting means for repeatedly transmitting 
said predetermined number of frames of image 
data together with said control information, 

and said receiving apparatus comprises: 

separating means for separating a frame of im- 
age data and corresponding control information 
from said broadcast wave; 
supplementary design storage means for stor- 
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ing at least one supplementary design; 
supplementary design reading means for read- 
ing a supplementary design from the supple- 
mentary design storage means, based on the 
separated control information; 
combining means for combining the read sup- 
plementary design with the separated image 
data; 

storage means for storing said combined image 
data and separated control information; 
reproducing means for reproducing said stored 
image data to output an image signal; 
operation means for receiving an operation in- 
struction from a user to switch image data; and 
control means for controlling said separating 
means to separate another frame of image data 
desiqnated by said control information stored 
in said storage means according to said oper- 
ation instruction. 
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